Sep 07 10:42:37 devstack cinder-volume[76297]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 10:42:37 devstack cinder-volume[76297]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 10:42:37 devstack cinder-volume[76297]: we strongly recommend against using it for new projects. Sep 07 10:42:37 devstack cinder-volume[76297]: If you are already using Eventlet, we recommend migrating to a different Sep 07 10:42:37 devstack cinder-volume[76297]: framework. For more detail see Sep 07 10:42:37 devstack cinder-volume[76297]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 10:42:37 devstack cinder-volume[76297]: import eventlet # noqa Sep 07 10:42:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 10:42:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 10:42:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 10:42:41 devstack cinder-volume[76297]: INFO dbcounter [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Registered counter for database cinder Sep 07 10:42:41 devstack cinder-volume[76297]: DEBUG oslo_db.sqlalchemy.engines [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:42:41 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writer thread running {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 10:42:41 devstack cinder-volume[76297]: INFO cinder.rpc [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 10:42:41 devstack cinder-volume[76297]: INFO cinder.rpc [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 10:42:41 devstack cinder-volume[76297]: DEBUG oslo_db.sqlalchemy.engines [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:42:41 devstack cinder-volume[76297]: INFO cinder.volume.manager [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Determined volume DB was empty at startup. Sep 07 10:42:41 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76297) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 10:42:41 devstack cinder-volume[76297]: INFO cinder.volume.manager [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 10:42:41 devstack cinder-volume[76297]: WARNING stevedore.named [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 10:42:41 devstack cinder-volume[76297]: WARNING castellan.key_manager [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 10:42:41 devstack cinder-volume[76297]: WARNING cinder.keymgr.conf_key_mgr [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 10:42:41 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76297) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 10:42:41 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.503s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_db.sqlalchemy.engines [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:42:42 devstack cinder-volume[76297]: INFO cinder.rpc [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 10:42:42 devstack cinder-volume[76297]: INFO cinder.rpc [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 10:42:42 devstack cinder-volume[76297]: WARNING stevedore.named [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 10:42:42 devstack cinder-volume[76297]: WARNING castellan.key_manager [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 10:42:42 devstack cinder-volume[76297]: INFO cinder.volume.manager [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_db.sqlalchemy.engines [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:42:42 devstack cinder-volume[76297]: INFO oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Starting 1 workers Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Started child 76444 {{(pid=76297) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Full set of CONF: {{(pid=76297) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] ******************************************************************************** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Configuration options gathered from: {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 10:42:42 devstack cinder-volume[76444]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] ================================================================================ {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] allow_availability_zone_fallback = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] allow_compression_on_image_upload = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] allowed_direct_url_schemes = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] api_rate_limit = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] auth_strategy = keystone {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] az_cache_duration = 3600 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_availability_zone = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_host = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_stats_polling_interval = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backup_api_class = cinder.backup.api.API {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backup_name_template = backup-%s {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backup_use_same_host = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backup_use_temp_snapshot = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] chap_password = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] chap_username = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_internal_tenant_project_id = f32b2ec656c44ee28c62148eb4d4babb {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_internal_tenant_user_id = 496d6c049b8d45279d1c44b87b14e65a {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cloned_volume_same_az = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cluster = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] compression_format = gzip {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] compute_api_class = cinder.compute.nova.API {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] config_dir = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] config_source = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] control_exchange = openstack {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] debug = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] default_availability_zone = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] default_group_type = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] default_volume_type = lvmdriver-1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] disk_geometry = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] driver_client_cert = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] driver_client_cert_key = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] driver_data_namespace = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] driver_ssl_cert_path = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] driver_ssl_cert_verify = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] driver_use_ssl = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] enable_force_upload = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] enable_new_services = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] enable_unsupported_driver = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] enforce_multipath_for_image_xfer = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] filter_function = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_api_insecure = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_api_ssl_compression = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_ca_certificates_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_catalog_info = image:glance:publicURL {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_num_retries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance_request_timeout = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] goodness_function = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] graceful_shutdown_timeout = 5 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] group_api_class = cinder.group.api.API {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] host = devstack {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_compress_on_upload = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_conversion_address_space_limit = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_conversion_cpu_limit = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_conversion_disable = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_upload_use_cinder_backend = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_upload_use_internal_tenant = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_volume_cache_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_volume_cache_max_count = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] image_volume_cache_max_size_gb = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] init_host_max_objects_retrieval = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] instance_format = [instance: %(uuid)s] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] iscsi_target_flags = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] iscsi_write_cache = on {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] iser_helper = tgtadm {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] iser_ip_address = 192.168.122.99 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] iser_port = 3260 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_color = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_config_append = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_dir = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_options = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_rotate_interval = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_rotate_interval_type = days {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] log_rotation_type = none {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] max_age = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] max_logfile_count = 30 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] max_logfile_size_mb = 200 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] max_over_subscription_ratio = 20.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] message_reap_interval = 86400 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] message_ttl = 2592000 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] migration_create_volume_timeout_secs = 300 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] monkey_patch = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] monkey_patch_modules = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76444]: INFO cinder.volume.manager [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] my_ip = 192.168.122.99 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] no_snapshot_gb_quota = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] num_iser_scan_tries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] num_shell_tries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] num_volume_device_scan_tries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] nvmeof_conn_info_version = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] nvmet_ns_id = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] nvmet_port_id = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] osapi_max_limit = 1000 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] osapi_volume_ext_list = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] osapi_volume_listen_port = 8776 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] osapi_volume_use_ssl = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] osapi_volume_workers = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] per_volume_size_limit = -1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] periodic_fuzzy_delay = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] periodic_interval = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] public_endpoint = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] publish_errors = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] quota_backup_gigabytes = 1000 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] quota_backups = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] quota_gigabytes = 1000 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] quota_groups = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] quota_snapshots = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] quota_volumes = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] rate_limit_burst = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] rate_limit_except_level = CRITICAL {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] rate_limit_interval = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] reinit_driver_count = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] replication_device = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] report_discard_supported = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] report_interval = 120 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] reservation_clean_interval = 86400 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] reservation_expire = 86400 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] reserved_image_namespaces = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] reserved_percentage = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] rpc_response_timeout = 120 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] run_external_periodic_tasks = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] scst_target_driver = iscsi {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] scst_target_iqn_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_down_time = 720 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] shell_completion = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] snapshot_name_template = snapshot-%s {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] snapshot_same_host = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] split_loggers = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] state_path = /opt/stack/data/cinder {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] storage_availability_zone = nova {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] storage_protocol = iSCSI {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] syslog_log_facility = LOG_USER {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] target_helper = lioadm {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] target_ip_address = 192.168.122.99 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] target_port = 3260 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] target_protocol = iscsi {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] target_secondary_ip_addresses = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] trace_flags = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] transport_url = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] until_refresh = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] use_chap_auth = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] use_default_quota_class = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] use_journal = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] use_json = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] use_multipath_for_image_xfer = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] use_stderr = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] use_syslog = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] verify_glance_signatures = enabled {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_api_class = cinder.volume.api.API {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_backend_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_clear = zero {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_clear_ionice = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_clear_size = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_copy_bps_limit = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_dd_blocksize = 1M {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_name_template = volume-%s {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_service_inithost_offload = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volume_usage_audit_period = month {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] zoning_mode = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:42:42 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_concurrency.disable_process_locking = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.auth_section = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.auth_type = password {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.auth_version = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.cache = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.include_service_catalog = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.insecure = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.interface = public {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_password = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcache_username = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.region_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.service_type = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.backend = dogpile.cache.null {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.backend_argument = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.backend_expiration_time = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.config_prefix = cache.oslo {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.debug_cache_backend = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.enable_retry_client = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.enable_socket_keepalive = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.expiration_time = 600 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.hashclient_retry_attempts = 2 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.memcache_dead_retry = 300 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.memcache_pool_maxsize = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.memcache_sasl_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.password = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.proxies = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.redis_db = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.redis_server = localhost:6379 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.retry_attempts = 2 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.retry_delay = 0.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.socket_keepalive_count = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.socket_keepalive_idle = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.socket_keepalive_interval = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.socket_timeout = 1.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.tls_allowed_ciphers = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.tls_cafile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.tls_certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.tls_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.tls_keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cache.username = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] coordination.backend_url = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.asyncio_connection = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.asyncio_slave_connection = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.backend = sqlalchemy {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.connection = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.connection_debug = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.connection_parameters = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.connection_recycle_time = 3600 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.connection_trace = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.db_inc_retry_interval = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.db_max_retries = 20 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.db_max_retry_interval = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.db_retry_interval = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.max_overflow = 50 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.max_pool_size = 5 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.max_retries = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.mysql_wsrep_sync_wait = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.pool_timeout = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.retry_interval = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.slave_connection = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.sqlite_synchronous = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.synchronous_reader = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] database.use_db_reconnect = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_tracing.insecure = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.connection_string = messaging:// {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.es_doc_type = notification {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.es_scroll_size = 10000 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.es_scroll_time = 2m {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.filter_error_trace = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.hmac_keys = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.sentinel_service_name = mymaster {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.socket_timeout = 0.1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.trace_requests = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler.trace_sqlalchemy = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler_jaeger.process_tags = {} {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler_jaeger.service_name_prefix = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] profiler_otlp.service_name_prefix = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.enforce_new_defaults = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.policy_default_rule = default {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.policy_file = policy.yaml {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] privsep_osbrick.group = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] privsep_osbrick.helper_command = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] privsep_osbrick.user = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack sudo[76493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_sys_admin.group = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_sys_admin.helper_command = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] cinder_sys_admin.user = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.auth_section = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.auth_type = password {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.cafile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack sudo[76493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.collect_timing = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.insecure = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.send_service_user_token = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.split_loggers = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.timeout = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.tls_ciphers = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] service_user.tls_min_version = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.auth_section = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.auth_type = password {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.collect_timing = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.insecure = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.region_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.split_loggers = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.timeout = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.tls_ciphers = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] glance.tls_min_version = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.backend_availability_zone = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.chap_password = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.chap_username = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.disk_geometry = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.driver_client_cert = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.driver_client_cert_key = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.driver_data_namespace = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.driver_use_ssl = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.extra_capabilities = {} {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.filter_function = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.goodness_function = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.iscsi_target_flags = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.iscsi_write_cache = on {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.iser_helper = tgtadm {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.iser_port = 3260 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.lvm_share_target = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.lvm_type = auto {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.num_shell_tries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.replication_device = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.report_discard_supported = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.reserved_percentage = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.target_helper = tgtadm {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.target_port = 3260 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.target_protocol = iscsi {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.trace_flags = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.unique_fqdn_network = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.use_chap_auth = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_backend_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_clear = zero {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_clear_ionice = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_clear_size = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_reports.file_event_handler = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_reports.log_dir = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.backend_host = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.chap_password = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.chap_username = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.disk_geometry = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.driver_client_cert = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.extra_capabilities = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.filter_function = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.goodness_function = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.iser_helper = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.iser_ip_address = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.iser_port = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.lvm_share_target = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.lvm_type = auto {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.num_shell_tries = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.replication_device = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.report_discard_supported = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.reserved_percentage = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.scst_target_driver = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.storage_protocol = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.target_helper = lioadm {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.target_ip_address = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.target_port = 3260 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.trace_flags = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.use_chap_auth = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_clear = zero {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_clear_size = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] lvmdriver-1.volumes_dir = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.ssl = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_notifications.driver = [] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_notifications.retry = -1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] key_manager.fixed_key = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.barbican_api_version = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.barbican_endpoint = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.barbican_endpoint_type = public {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.barbican_region_name = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.cafile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.collect_timing = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.insecure = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.number_of_retries = 60 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.retry_delay = 1 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.send_service_user_token = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.split_loggers = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.timeout = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.tls_ciphers = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.tls_min_version = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.verify_ssl = True {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican.verify_ssl_path = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.auth_section = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.auth_type = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.cafile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.certfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.collect_timing = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.insecure = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.keyfile = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.split_loggers = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.timeout = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.tls_ciphers = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] barbican_service_user.tls_min_version = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.approle_role_id = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.approle_secret_id = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.auth_method = approle {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.auth_path = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.kv_mountpoint = secret {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.kv_path = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.kv_version = 2 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.namespace = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.root_token_id = **** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.ssl_ca_crt_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.timeout = 60.0 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.token_file = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.token_role = None {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.use_ssl = False {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:42:42 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] ******************************************************************************** {{(pid=76297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 10:42:43 devstack sudo[76493]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:43 devstack sudo[76641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:43 devstack sudo[76641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:43 devstack sudo[76641]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.263s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:42:43 devstack cinder-volume[76444]: INFO cinder.brick.local_dev.lvm [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:43 devstack sudo[76734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:42:43 devstack sudo[76734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:43 devstack sudo[76734]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG cinder.brick.local_dev.lvm [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76444) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 10:42:43 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:43 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:43 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:44 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.529s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:44 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:44 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:44 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:44 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 10:42:44 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:44 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.342s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:44 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:44 devstack sudo[77143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:42:44 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:45 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:45 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:45 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:45 devstack sudo[77146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:42:45 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:45 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:45 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:45 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:45 devstack sudo[77190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:42:45 devstack sudo[77190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:45 devstack sudo[77190]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:45 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:45 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:45 devstack sudo[77238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:45 devstack sudo[77238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:45 devstack sudo[77238]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:45 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:46 devstack sudo[77242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:46 devstack sudo[77242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:46 devstack sudo[77242]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:46 devstack cinder-volume[76444]: INFO cinder.volume.drivers.lvm [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:46 devstack sudo[77252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:46 devstack sudo[77252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:46 devstack sudo[77252]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG cinder.volume.drivers.lvm [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Updating volume stats {{(pid=76444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:46 devstack sudo[77255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:42:46 devstack sudo[77255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:46 devstack sudo[77255]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:46 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:46 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:42:46 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:47 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:47 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:47 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:47 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:47 devstack sudo[77264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:42:47 devstack sudo[77264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:47 devstack sudo[77264]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:47 devstack cinder-volume[76444]: INFO cinder.volume.driver [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Driver hasn't implemented _init_vendor_properties() Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG cinder.volume.driver [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76444) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG oslo_db.sqlalchemy.engines [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG dbcounter [-] [76444] Writer thread running {{(pid=76444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG cinder.db.api [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Building query based on filter {{(pid=76444) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG cinder.image.image_utils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76444) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 10:42:47 devstack cinder-volume[76444]: INFO cinder.keymgr.migration [None req-13dbc337-916c-441c-8ff8-b1889097e859 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG cinder.volume.drivers.lvm [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Updating volume stats {{(pid=76444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 10:42:47 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:47 devstack sudo[77269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:42:47 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:48 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:48 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:48 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:48 devstack sudo[77307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:42:48 devstack sudo[77307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:48 devstack sudo[77307]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:48 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:48 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:48 devstack sudo[77310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:48 devstack sudo[77310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:48 devstack sudo[77310]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:48 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:48 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:48 devstack sudo[77313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:42:48 devstack sudo[77313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:49 devstack sudo[77313]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG cinder.manager [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Notifying Schedulers of capabilities ... {{(pid=76444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:42:49 devstack cinder-volume[76444]: INFO cinder.volume.manager [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Driver initialization completed successfully. Sep 07 10:42:49 devstack cinder-volume[76444]: INFO cinder.manager [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Initiating service 2 cleanup Sep 07 10:42:49 devstack cinder-volume[76444]: INFO cinder.manager [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Service 2 cleanup completed. Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG cinder.service [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Creating RPC server for service cinder-volume {{(pid=76444) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG cinder.service [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76444) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 10:42:49 devstack cinder-volume[76444]: INFO cinder.volume.manager [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG cinder.volume.drivers.lvm [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Updating volume stats {{(pid=76444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:49 devstack sudo[77320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:42:49 devstack sudo[77320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:49 devstack sudo[77320]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:49 devstack sudo[77326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:42:49 devstack sudo[77326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:49 devstack sudo[77326]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:49 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:49 devstack sudo[77329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:42:49 devstack sudo[77329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:50 devstack sudo[77329]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:50 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:50 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:42:50 devstack sudo[77332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:42:50 devstack sudo[77332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:42:50 devstack sudo[77332]: pam_unix(sudo:session): session closed for user root Sep 07 10:42:50 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:42:50 devstack cinder-volume[76444]: INFO cinder.volume.manager [None req-12dfe950-02a4-4601-ae0a-64c50b2da15b None None] Driver post RPC initialization completed successfully. Sep 07 10:42:52 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:43:00 devstack cinder-volume[76444]: DEBUG dbcounter [-] [76444] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:43:00 devstack cinder-volume[76444]: DEBUG dbcounter [-] [76444] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:43:19 devstack cinder-volume[76444]: DEBUG oslo_service.periodic_task [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running periodic task VolumeManager._thread_info {{(pid=76444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:43:19 devstack cinder-volume[76444]: DEBUG cinder.volume.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] thread count: 6 {{(pid=76444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:43:19 devstack cinder-volume[76444]: DEBUG cinder.volume.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] thread info: [<_MainThread(MainThread, started 130961435156608)>, , , , , ] {{(pid=76444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:44:19 devstack cinder-volume[76444]: DEBUG oslo_service.periodic_task [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:44:19 devstack cinder-volume[76444]: DEBUG cinder.volume.drivers.lvm [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Updating volume stats {{(pid=76444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 10:44:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:44:19 devstack sudo[79980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:44:19 devstack sudo[79980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:44:19 devstack sudo[79980]: pam_unix(sudo:session): session closed for user root Sep 07 10:44:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:44:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:44:19 devstack sudo[79983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:44:19 devstack sudo[79983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:44:19 devstack sudo[79983]: pam_unix(sudo:session): session closed for user root Sep 07 10:44:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:44:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:44:19 devstack sudo[79986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:44:19 devstack sudo[79986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:44:20 devstack sudo[79986]: pam_unix(sudo:session): session closed for user root Sep 07 10:44:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:44:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:44:20 devstack sudo[79989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:44:20 devstack sudo[79989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:44:20 devstack sudo[79989]: pam_unix(sudo:session): session closed for user root Sep 07 10:44:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:44:20 devstack cinder-volume[76444]: DEBUG cinder.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Notifying Schedulers of capabilities ... {{(pid=76444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:44:20 devstack cinder-volume[76444]: DEBUG oslo_service.periodic_task [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running periodic task VolumeManager._thread_info {{(pid=76444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:44:20 devstack cinder-volume[76444]: DEBUG cinder.volume.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] thread count: 6 {{(pid=76444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:44:20 devstack cinder-volume[76444]: DEBUG cinder.volume.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] thread info: [<_MainThread(MainThread, started 130961435156608)>, , , , , ] {{(pid=76444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:45:00 devstack cinder-volume[76444]: DEBUG dbcounter [-] [76444] Writing DB stats cinder:SELECT=1 {{(pid=76444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:45:00 devstack cinder-volume[76444]: DEBUG dbcounter [-] [76444] Writing DB stats cinder:UPDATE=1 {{(pid=76444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:45:19 devstack cinder-volume[76444]: DEBUG oslo_service.periodic_task [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:45:19 devstack cinder-volume[76444]: DEBUG cinder.volume.drivers.lvm [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Updating volume stats {{(pid=76444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 10:45:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:45:19 devstack sudo[83775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:45:19 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:45:19 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root Sep 07 10:45:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:45:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:45:19 devstack sudo[83798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:45:19 devstack sudo[83798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:45:19 devstack sudo[83798]: pam_unix(sudo:session): session closed for user root Sep 07 10:45:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:45:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:45:19 devstack sudo[83827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:45:19 devstack sudo[83827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:45:20 devstack sudo[83827]: pam_unix(sudo:session): session closed for user root Sep 07 10:45:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:45:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:45:20 devstack sudo[83842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:45:20 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:45:20 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root Sep 07 10:45:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:45:20 devstack cinder-volume[76444]: DEBUG cinder.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Notifying Schedulers of capabilities ... {{(pid=76444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:46:19 devstack cinder-volume[76444]: DEBUG oslo_service.periodic_task [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:46:19 devstack cinder-volume[76444]: DEBUG cinder.volume.drivers.lvm [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Updating volume stats {{(pid=76444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 10:46:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:46:19 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 10:46:19 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:46:19 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Sep 07 10:46:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:46:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:46:19 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:46:19 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:46:19 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Sep 07 10:46:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:46:19 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:46:19 devstack sudo[85417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 10:46:19 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:46:20 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root Sep 07 10:46:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:46:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:46:20 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 10:46:20 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:46:20 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Sep 07 10:46:20 devstack cinder-volume[76444]: DEBUG oslo_concurrency.processutils [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:46:20 devstack cinder-volume[76444]: DEBUG cinder.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Notifying Schedulers of capabilities ... {{(pid=76444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:46:20 devstack cinder-volume[76444]: DEBUG oslo_service.periodic_task [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] Running periodic task VolumeManager._thread_info {{(pid=76444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:46:20 devstack cinder-volume[76444]: DEBUG cinder.volume.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] thread count: 6 {{(pid=76444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:46:20 devstack cinder-volume[76444]: DEBUG cinder.volume.manager [None req-ff843775-5b36-44cf-a258-17f3e897f569 None None] thread info: [<_MainThread(MainThread, started 130961435156608)>, , , , , ] {{(pid=76444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:47:00 devstack cinder-volume[76444]: DEBUG dbcounter [-] [76444] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:47:07 devstack cinder-volume[76297]: INFO oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Caught SIGTERM, stopping children Sep 07 10:47:07 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Acquiring lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 10:47:07 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Acquired lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 10:47:07 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Releasing lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 10:47:07 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Stop services. {{(pid=76297) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 10:47:07 devstack cinder-volume[76297]: DEBUG oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Killing children. {{(pid=76297) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 10:47:07 devstack cinder-volume[76297]: INFO oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Waiting on 1 children to exit Sep 07 10:47:09 devstack cinder-volume[76444]: DEBUG oslo_concurrency.lockutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Acquiring lock "singleton_lock" {{(pid=76444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 10:47:09 devstack cinder-volume[76444]: DEBUG oslo_concurrency.lockutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Acquired lock "singleton_lock" {{(pid=76444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 10:47:09 devstack cinder-volume[76444]: DEBUG oslo_concurrency.lockutils [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Releasing lock "singleton_lock" {{(pid=76444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 10:47:09 devstack cinder-volume[76444]: WARNING amqp [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 10:47:09 devstack cinder-volume[76444]: WARNING amqp [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 10:47:09 devstack cinder-volume[76297]: INFO oslo_service.backend._eventlet.service [None req-aad44048-1c2d-44b5-9fb5-41e24befc2b6 None None] Child 76444 exited with status 0 Sep 07 10:47:09 devstack cinder-volume[86460]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 10:47:09 devstack cinder-volume[86460]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 10:47:09 devstack cinder-volume[86460]: we strongly recommend against using it for new projects. Sep 07 10:47:09 devstack cinder-volume[86460]: If you are already using Eventlet, we recommend migrating to a different Sep 07 10:47:09 devstack cinder-volume[86460]: framework. For more detail see Sep 07 10:47:09 devstack cinder-volume[86460]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 10:47:09 devstack cinder-volume[86460]: import eventlet # noqa Sep 07 10:47:11 devstack cinder-volume[86460]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86460) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 10:47:11 devstack cinder-volume[86460]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86460) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 10:47:11 devstack cinder-volume[86460]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86460) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 10:47:12 devstack cinder-volume[86460]: INFO dbcounter [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Registered counter for database cinder Sep 07 10:47:12 devstack cinder-volume[86460]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86460) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:12 devstack cinder-volume[86460]: DEBUG dbcounter [-] [86460] Writer thread running {{(pid=86460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 10:47:12 devstack cinder-volume[86460]: INFO cinder.rpc [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 10:47:12 devstack cinder-volume[86460]: INFO cinder.rpc [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 10:47:12 devstack cinder-volume[86460]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86460) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:12 devstack cinder-volume[86460]: INFO cinder.volume.manager [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Determined volume DB was empty at startup. Sep 07 10:47:12 devstack cinder-volume[86460]: DEBUG cinder.volume.manager [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86460) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 10:47:12 devstack cinder-volume[86460]: INFO cinder.volume.manager [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 10:47:12 devstack cinder-volume[86460]: WARNING stevedore.named [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 10:47:12 devstack cinder-volume[86460]: WARNING castellan.key_manager [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 10:47:12 devstack cinder-volume[86460]: WARNING cinder.keymgr.conf_key_mgr [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 10:47:13 devstack cinder-volume[86460]: INFO cinder.volume.manager [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86460) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:13 devstack cinder-volume[86460]: INFO oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Starting 1 workers Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Started child 86678 {{(pid=86460) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Full set of CONF: {{(pid=86460) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] ******************************************************************************** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Configuration options gathered from: {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] ================================================================================ {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] allow_availability_zone_fallback = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] allow_compression_on_image_upload = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] allowed_direct_url_schemes = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] api_rate_limit = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] auth_strategy = keystone {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86678]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_availability_zone = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_host = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_stats_polling_interval = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backup_api_class = cinder.backup.api.API {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backup_name_template = backup-%s {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backup_use_same_host = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backup_use_temp_snapshot = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] chap_password = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] chap_username = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_internal_tenant_project_id = f32b2ec656c44ee28c62148eb4d4babb {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_internal_tenant_user_id = 496d6c049b8d45279d1c44b87b14e65a {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cluster = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] compression_format = gzip {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] compute_api_class = cinder.compute.nova.API {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] config_dir = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] config_source = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] control_exchange = openstack {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] debug = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] default_availability_zone = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] default_group_type = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] default_volume_type = QuobyteHD {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] disk_geometry = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] driver_client_cert = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] driver_client_cert_key = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] driver_data_namespace = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] driver_ssl_cert_path = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] driver_ssl_cert_verify = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] driver_use_ssl = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] enable_new_services = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] enable_unsupported_driver = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] enabled_backends = ['QuobyteHD'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] enforce_multipath_for_image_xfer = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] filter_function = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_api_insecure = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_api_ssl_compression = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_ca_certificates_file = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_catalog_info = image:glance:publicURL {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_num_retries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance_request_timeout = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] goodness_function = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] graceful_shutdown_timeout = 5 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] group_api_class = cinder.group.api.API {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] host = devstack {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_compress_on_upload = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_conversion_address_space_limit = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_conversion_cpu_limit = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_conversion_disable = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_upload_use_cinder_backend = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_upload_use_internal_tenant = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_volume_cache_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_volume_cache_max_count = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] image_volume_cache_max_size_gb = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] init_host_max_objects_retrieval = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] instance_format = [instance: %(uuid)s] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] iscsi_target_flags = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] iscsi_write_cache = on {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] iser_helper = tgtadm {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] iser_ip_address = 192.168.122.99 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] iser_port = 3260 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_color = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_config_append = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86678]: INFO cinder.volume.manager [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.remotefs [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86678) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_dir = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_file = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_options = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_rotate_interval = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_rotate_interval_type = days {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] log_rotation_type = none {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] max_age = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] max_logfile_count = 30 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] max_logfile_size_mb = 200 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] max_over_subscription_ratio = 20.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] message_reap_interval = 86400 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] message_ttl = 2592000 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] migration_create_volume_timeout_secs = 300 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] monkey_patch = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] monkey_patch_modules = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] my_ip = 192.168.122.99 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] no_snapshot_gb_quota = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] num_iser_scan_tries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] num_shell_tries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] num_volume_device_scan_tries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] nvmeof_conn_info_version = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] nvmet_ns_id = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] nvmet_port_id = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] osapi_max_limit = 1000 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] osapi_volume_ext_list = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] osapi_volume_listen_port = 8776 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] osapi_volume_use_ssl = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] osapi_volume_workers = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] per_volume_size_limit = -1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] periodic_fuzzy_delay = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] periodic_interval = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] public_endpoint = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] publish_errors = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] quota_backup_gigabytes = 1000 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] quota_backups = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] quota_gigabytes = 1000 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] quota_groups = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] quota_snapshots = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] quota_volumes = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] rate_limit_burst = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] rate_limit_except_level = CRITICAL {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] rate_limit_interval = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] reinit_driver_count = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] replication_device = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] report_discard_supported = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] report_interval = 120 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] reservation_clean_interval = 86400 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] reservation_expire = 86400 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] reserved_image_namespaces = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] reserved_percentage = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] rpc_response_timeout = 120 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] run_external_periodic_tasks = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] scst_target_driver = iscsi {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] scst_target_iqn_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_down_time = 720 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] shell_completion = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] snapshot_name_template = snapshot-%s {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] split_loggers = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] state_path = /opt/stack/data/cinder {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] storage_availability_zone = nova {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] storage_protocol = iSCSI {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] syslog_log_facility = LOG_USER {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] target_helper = lioadm {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] target_ip_address = 192.168.122.99 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] target_port = 3260 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] target_protocol = iscsi {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] target_secondary_ip_addresses = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] trace_flags = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] transport_url = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] until_refresh = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] use_chap_auth = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] use_default_quota_class = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] use_journal = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] use_json = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] use_multipath_for_image_xfer = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] use_stderr = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] use_syslog = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] verify_glance_signatures = enabled {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_api_class = cinder.volume.api.API {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_backend_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_clear = zero {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_clear_ionice = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_clear_size = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_copy_bps_limit = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_dd_blocksize = 1M {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_name_template = volume-%s {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_service_inithost_offload = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volume_usage_audit_period = month {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] zoning_mode = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_concurrency.disable_process_locking = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.auth_section = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.auth_type = password {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.auth_version = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.cache = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.include_service_catalog = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.insecure = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.interface = public {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_password = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcache_username = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.region_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.service_type = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.backend = dogpile.cache.null {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.backend_argument = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.backend_expiration_time = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.config_prefix = cache.oslo {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86678) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 10:47:13 devstack cinder-volume[86678]: WARNING cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 10:47:13 devstack cinder-volume[86678]: WARNING cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.debug_cache_backend = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.enable_retry_client = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.enable_socket_keepalive = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.expiration_time = 600 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.hashclient_retry_attempts = 2 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.memcache_dead_retry = 300 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Running cmd (subprocess): mount.quobyte {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.memcache_pool_maxsize = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.memcache_sasl_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.password = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.proxies = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.redis_db = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.redis_server = localhost:6379 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.retry_attempts = 2 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.retry_delay = 0.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.socket_keepalive_count = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.socket_keepalive_idle = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.socket_keepalive_interval = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.socket_timeout = 1.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.tls_allowed_ciphers = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.tls_cafile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.tls_certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.tls_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.tls_keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cache.username = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] coordination.backend_url = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.asyncio_connection = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.asyncio_slave_connection = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.backend = sqlalchemy {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.connection = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.connection_debug = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.connection_parameters = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.connection_recycle_time = 3600 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.connection_trace = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.db_inc_retry_interval = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.db_max_retries = 20 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.db_max_retry_interval = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.db_retry_interval = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.max_overflow = 50 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.max_pool_size = 5 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.max_retries = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.mysql_wsrep_sync_wait = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.pool_timeout = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.retry_interval = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.slave_connection = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.sqlite_synchronous = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.synchronous_reader = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] database.use_db_reconnect = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_tracing.insecure = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.connection_string = messaging:// {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.es_doc_type = notification {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.es_scroll_size = 10000 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.es_scroll_time = 2m {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.filter_error_trace = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.hmac_keys = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.sentinel_service_name = mymaster {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.socket_timeout = 0.1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.trace_requests = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler.trace_sqlalchemy = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler_jaeger.process_tags = {} {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler_jaeger.service_name_prefix = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] profiler_otlp.service_name_prefix = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.enforce_new_defaults = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.policy_default_rule = default {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.policy_file = policy.yaml {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] privsep_osbrick.group = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] privsep_osbrick.helper_command = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] privsep_osbrick.user = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_sys_admin.group = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_sys_admin.helper_command = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] cinder_sys_admin.user = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.auth_section = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.auth_type = password {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.cafile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.collect_timing = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.insecure = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.send_service_user_token = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.split_loggers = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.timeout = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.tls_ciphers = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] service_user.tls_min_version = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.auth_section = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.auth_type = password {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.collect_timing = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.insecure = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.region_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.split_loggers = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.timeout = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.tls_ciphers = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] glance.tls_min_version = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.backend_availability_zone = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.chap_password = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.chap_username = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.disk_geometry = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.driver_client_cert = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.driver_client_cert_key = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.driver_data_namespace = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.driver_use_ssl = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.extra_capabilities = {} {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.filter_function = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.goodness_function = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.iscsi_target_flags = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.iscsi_write_cache = on {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.iser_helper = tgtadm {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.iser_port = 3260 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_host = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_login = admin {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_mount_options = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_password = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_private_key = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_share_path = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.num_shell_tries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.quobyte_volume_url = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.replication_device = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.report_discard_supported = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.reserved_percentage = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.target_helper = tgtadm {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.target_port = 3260 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.target_protocol = iscsi {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.trace_flags = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.unique_fqdn_network = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.use_chap_auth = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_backend_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_clear = zero {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_clear_ionice = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_clear_size = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_reports.file_event_handler = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_reports.log_dir = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.backend_availability_zone = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.backend_host = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.chap_password = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.chap_username = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.chiscsi_conf = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.disk_geometry = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.driver_client_cert = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.driver_data_namespace = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.driver_use_ssl = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.extra_capabilities = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.filter_function = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.goodness_function = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.iser_helper = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.iser_ip_address = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.iser_port = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.iser_target_prefix = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_host = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_login = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_mount_options = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_password = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_private_key = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_share_path = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_ssh_port = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.num_shell_tries = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.nvmet_port_id = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.replication_device = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.report_discard_supported = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.reserved_percentage = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.scst_target_driver = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.storage_protocol = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.target_helper = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.target_ip_address = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.target_port = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.target_prefix = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.target_protocol = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.trace_flags = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.use_chap_auth = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_clear = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_clear_size = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] QuobyteHD.volumes_dir = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.ssl = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_notifications.driver = [] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_notifications.retry = -1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] key_manager.fixed_key = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.barbican_api_version = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack quobyte-client[86683]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.barbican_endpoint = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.barbican_endpoint_type = public {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.barbican_region_name = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.cafile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.collect_timing = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.insecure = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack quobyte-client[86683]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.number_of_retries = 60 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.retry_delay = 1 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.send_service_user_token = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.split_loggers = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.timeout = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.tls_ciphers = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.tls_min_version = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.verify_ssl = True {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=86678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican.verify_ssl_path = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.auth_section = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.auth_type = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86678]: INFO cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e ... Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.cafile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.certfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 -c /etc/quobyte/client-cinder.cfg {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.collect_timing = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.insecure = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.keyfile = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.split_loggers = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.timeout = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.tls_ciphers = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] barbican_service_user.tls_min_version = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.approle_role_id = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.approle_secret_id = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.auth_method = approle {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.auth_path = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.kv_mountpoint = secret {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.kv_path = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.kv_version = 2 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.namespace = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.root_token_id = **** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.ssl_ca_crt_file = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.timeout = 60.0 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.token_file = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.token_role = None {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.use_ssl = False {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:13 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] ******************************************************************************** {{(pid=86460) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 10:47:13 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 -c /etc/quobyte/client-cinder.cfg Sep 07 10:47:13 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:47:13 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.376s {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:13 devstack cinder-volume[86678]: INFO cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e succeeded Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=86678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.389s {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:47:13 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:13 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:47:13 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:47:14 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.244s {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:14 devstack cinder-volume[86678]: INFO cinder.volume.driver [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Driver hasn't implemented _init_vendor_properties() Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.volume.driver [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5949935913086, 'free_capacity_gb': 1773.5949935913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86678) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_db.sqlalchemy.engines [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG dbcounter [-] [86678] Writer thread running {{(pid=86678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.db.api [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Building query based on filter {{(pid=86678) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.image.image_utils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86678) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 10:47:14 devstack cinder-volume[86678]: INFO cinder.keymgr.migration [None req-1999709c-b4ad-45cd-bcc7-40a5d29dbd71 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=86678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=86678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:14 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:47:14 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:47:14 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.235s {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.manager [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Notifying Schedulers of capabilities ... {{(pid=86678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:47:14 devstack cinder-volume[86678]: INFO cinder.volume.manager [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Driver initialization completed successfully. Sep 07 10:47:14 devstack cinder-volume[86678]: INFO cinder.manager [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Initiating service 3 cleanup Sep 07 10:47:14 devstack cinder-volume[86678]: INFO cinder.manager [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Service 3 cleanup completed. Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.service [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Creating RPC server for service cinder-volume {{(pid=86678) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.service [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86678) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 10:47:14 devstack cinder-volume[86678]: INFO cinder.volume.manager [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=86678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG cinder.volume.drivers.quobyte [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=86678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86678) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:14 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:47:14 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:47:14 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Sep 07 10:47:14 devstack cinder-volume[86678]: DEBUG oslo_concurrency.processutils [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.286s {{(pid=86678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:14 devstack cinder-volume[86678]: INFO cinder.volume.manager [None req-ec5fdcc0-2476-4b6f-9854-3c11162a8eeb None None] Driver post RPC initialization completed successfully. Sep 07 10:47:18 devstack cinder-volume[86460]: INFO oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Caught SIGTERM, stopping children Sep 07 10:47:18 devstack cinder-volume[86460]: DEBUG oslo_concurrency.lockutils [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Acquiring lock "singleton_lock" {{(pid=86460) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 10:47:18 devstack cinder-volume[86460]: DEBUG oslo_concurrency.lockutils [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Acquired lock "singleton_lock" {{(pid=86460) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 10:47:18 devstack cinder-volume[86460]: DEBUG oslo_concurrency.lockutils [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Releasing lock "singleton_lock" {{(pid=86460) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 10:47:18 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Stop services. {{(pid=86460) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 10:47:18 devstack cinder-volume[86460]: DEBUG oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Killing children. {{(pid=86460) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 10:47:18 devstack cinder-volume[86460]: INFO oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Waiting on 1 children to exit Sep 07 10:47:22 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Acquiring lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 10:47:22 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Acquired lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 10:47:22 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Releasing lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 10:47:22 devstack cinder-volume[86678]: WARNING amqp [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 10:47:22 devstack cinder-volume[86678]: WARNING amqp [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 10:47:22 devstack cinder-volume[86460]: INFO oslo_service.backend._eventlet.service [None req-f6b8bf5e-3a6c-4471-86d3-ef4e9169e716 None None] Child 86678 exited with status 0 Sep 07 10:47:23 devstack cinder-volume[86969]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 10:47:23 devstack cinder-volume[86969]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 10:47:23 devstack cinder-volume[86969]: we strongly recommend against using it for new projects. Sep 07 10:47:23 devstack cinder-volume[86969]: If you are already using Eventlet, we recommend migrating to a different Sep 07 10:47:23 devstack cinder-volume[86969]: framework. For more detail see Sep 07 10:47:23 devstack cinder-volume[86969]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 10:47:23 devstack cinder-volume[86969]: import eventlet # noqa Sep 07 10:47:25 devstack cinder-volume[86969]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 10:47:25 devstack cinder-volume[86969]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 10:47:25 devstack cinder-volume[86969]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 10:47:26 devstack cinder-volume[86969]: INFO dbcounter [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Registered counter for database cinder Sep 07 10:47:26 devstack cinder-volume[86969]: DEBUG oslo_db.sqlalchemy.engines [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG dbcounter [-] [86969] Writer thread running {{(pid=86969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 10:47:27 devstack cinder-volume[86969]: INFO cinder.rpc [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 10:47:27 devstack cinder-volume[86969]: INFO cinder.rpc [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_db.sqlalchemy.engines [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:27 devstack cinder-volume[86969]: INFO cinder.volume.manager [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Determined volume DB was empty at startup. Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG cinder.volume.manager [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86969) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 10:47:27 devstack cinder-volume[86969]: WARNING stevedore.named [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 10:47:27 devstack cinder-volume[86969]: WARNING castellan.key_manager [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 10:47:27 devstack cinder-volume[86969]: WARNING cinder.keymgr.conf_key_mgr [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 10:47:27 devstack cinder-volume[86969]: INFO cinder.volume.manager [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_db.sqlalchemy.engines [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:27 devstack cinder-volume[86969]: INFO oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Starting 1 workers Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Started child 87271 {{(pid=86969) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Full set of CONF: {{(pid=86969) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] ******************************************************************************** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] Configuration options gathered from: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] ================================================================================ {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] allow_availability_zone_fallback = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] allow_compression_on_image_upload = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] allowed_direct_url_schemes = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] api_rate_limit = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] auth_strategy = keystone {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_availability_zone = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_host = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_stats_polling_interval = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backup_api_class = cinder.backup.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backup_name_template = backup-%s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backup_use_same_host = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backup_use_temp_snapshot = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] chap_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] chap_username = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_internal_tenant_project_id = f32b2ec656c44ee28c62148eb4d4babb {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_internal_tenant_user_id = 496d6c049b8d45279d1c44b87b14e65a {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cluster = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] compression_format = gzip {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] compute_api_class = cinder.compute.nova.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[87271]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] config_dir = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] config_source = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] control_exchange = openstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] debug = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] default_availability_zone = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] default_group_type = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] default_volume_type = QuobyteHD {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] disk_geometry = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] driver_client_cert = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] driver_client_cert_key = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] driver_data_namespace = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] driver_ssl_cert_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] driver_ssl_cert_verify = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] driver_use_ssl = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] enable_new_services = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] enable_unsupported_driver = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] enabled_backends = ['QuobyteHD'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] enforce_multipath_for_image_xfer = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] filter_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_api_insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_api_ssl_compression = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_ca_certificates_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_catalog_info = image:glance:publicURL {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_num_retries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance_request_timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] goodness_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] graceful_shutdown_timeout = 5 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] group_api_class = cinder.group.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] host = devstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_compress_on_upload = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_conversion_address_space_limit = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_conversion_cpu_limit = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_conversion_disable = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_upload_use_cinder_backend = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_upload_use_internal_tenant = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_volume_cache_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_volume_cache_max_count = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] image_volume_cache_max_size_gb = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] init_host_max_objects_retrieval = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] instance_format = [instance: %(uuid)s] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] iscsi_target_flags = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] iscsi_write_cache = on {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] iser_helper = tgtadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] iser_ip_address = 192.168.122.99 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] iser_port = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_color = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_config_append = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_dir = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_options = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_rotate_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_rotate_interval_type = days {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] log_rotation_type = none {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] max_age = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] max_logfile_count = 30 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] max_logfile_size_mb = 200 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] max_over_subscription_ratio = 20.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] message_reap_interval = 86400 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] message_ttl = 2592000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] migration_create_volume_timeout_secs = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] monkey_patch = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] monkey_patch_modules = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] my_ip = 192.168.122.99 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] no_snapshot_gb_quota = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] num_iser_scan_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] num_shell_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] num_volume_device_scan_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] nvmeof_conn_info_version = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] nvmet_ns_id = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] nvmet_port_id = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] osapi_max_limit = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] osapi_volume_ext_list = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] osapi_volume_listen_port = 8776 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] osapi_volume_use_ssl = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] osapi_volume_workers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] per_volume_size_limit = -1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] periodic_fuzzy_delay = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] periodic_interval = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] public_endpoint = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] publish_errors = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] quota_backup_gigabytes = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] quota_backups = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] quota_gigabytes = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] quota_groups = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] quota_snapshots = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] quota_volumes = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] rate_limit_burst = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] rate_limit_except_level = CRITICAL {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] rate_limit_interval = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] reinit_driver_count = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] replication_device = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] report_discard_supported = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] report_interval = 120 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] reservation_clean_interval = 86400 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] reservation_expire = 86400 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87271) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] reserved_image_namespaces = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] reserved_percentage = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] rpc_response_timeout = 120 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] run_external_periodic_tasks = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] scst_target_driver = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] scst_target_iqn_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_down_time = 720 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] shell_completion = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] snapshot_name_template = snapshot-%s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] split_loggers = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] state_path = /opt/stack/data/cinder {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] storage_availability_zone = nova {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] storage_protocol = iSCSI {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] syslog_log_facility = LOG_USER {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] target_helper = lioadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] target_ip_address = 192.168.122.99 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] target_port = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] target_protocol = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] target_secondary_ip_addresses = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] trace_flags = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] transport_url = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] until_refresh = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] use_chap_auth = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] use_default_quota_class = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] use_journal = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] use_json = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] use_multipath_for_image_xfer = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] use_stderr = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] use_syslog = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] verify_glance_signatures = enabled {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_api_class = cinder.volume.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_backend_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_clear = zero {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_clear_ionice = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_clear_size = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_copy_bps_limit = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_dd_blocksize = 1M {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_name_template = volume-%s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_service_inithost_offload = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volume_usage_audit_period = month {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] zoning_mode = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_concurrency.disable_process_locking = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.auth_section = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.auth_type = password {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.auth_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.cache = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.include_service_catalog = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.interface = public {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcache_username = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.region_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.service_type = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.backend = dogpile.cache.null {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.backend_argument = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.backend_expiration_time = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.config_prefix = cache.oslo {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.debug_cache_backend = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.enable_retry_client = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.enable_socket_keepalive = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.expiration_time = 600 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.hashclient_retry_attempts = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.memcache_dead_retry = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.memcache_pool_maxsize = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.memcache_sasl_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.proxies = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.redis_db = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.redis_server = localhost:6379 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.retry_attempts = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.retry_delay = 0.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.socket_keepalive_count = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.socket_keepalive_idle = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.socket_keepalive_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.socket_timeout = 1.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.tls_allowed_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.tls_cafile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.tls_certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.tls_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.tls_keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cache.username = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] coordination.backend_url = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.asyncio_connection = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.asyncio_slave_connection = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.backend = sqlalchemy {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.connection = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.connection_debug = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.connection_parameters = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.connection_recycle_time = 3600 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.connection_trace = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.db_inc_retry_interval = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.db_max_retries = 20 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.db_max_retry_interval = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.db_retry_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.max_overflow = 50 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.max_pool_size = 5 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.max_retries = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.mysql_wsrep_sync_wait = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.pool_timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.retry_interval = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.slave_connection = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.sqlite_synchronous = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.synchronous_reader = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] database.use_db_reconnect = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_tracing.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.connection_string = messaging:// {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.es_doc_type = notification {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.es_scroll_size = 10000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.es_scroll_time = 2m {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.filter_error_trace = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.hmac_keys = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.sentinel_service_name = mymaster {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.socket_timeout = 0.1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.trace_requests = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler.trace_sqlalchemy = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler_jaeger.process_tags = {} {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler_jaeger.service_name_prefix = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] profiler_otlp.service_name_prefix = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.enforce_new_defaults = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.policy_default_rule = default {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.policy_file = policy.yaml {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87271) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] privsep_osbrick.group = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] privsep_osbrick.helper_command = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] privsep_osbrick.user = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_sys_admin.group = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_sys_admin.helper_command = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] cinder_sys_admin.user = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.auth_section = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.auth_type = password {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Running cmd (subprocess): mount.quobyte {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.cafile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.collect_timing = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.send_service_user_token = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.split_loggers = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.tls_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] service_user.tls_min_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.auth_section = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.auth_type = password {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.collect_timing = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.region_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.split_loggers = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.tls_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] glance.tls_min_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.backend_availability_zone = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.chap_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.chap_username = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.disk_geometry = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.driver_client_cert = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.driver_client_cert_key = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.driver_data_namespace = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.driver_use_ssl = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.extra_capabilities = {} {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.filter_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.goodness_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.iscsi_target_flags = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.iscsi_write_cache = on {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.iser_helper = tgtadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.iser_port = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_host = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_login = admin {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_mount_options = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_private_key = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_share_path = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.num_shell_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.quobyte_volume_url = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.replication_device = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.report_discard_supported = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.reserved_percentage = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.target_helper = tgtadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.target_port = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.target_protocol = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.trace_flags = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.unique_fqdn_network = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.use_chap_auth = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_backend_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_clear = zero {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_clear_ionice = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_clear_size = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_reports.file_event_handler = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_reports.log_dir = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.backend_availability_zone = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.backend_host = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.chap_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.chap_username = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.chiscsi_conf = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.disk_geometry = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.driver_client_cert = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.driver_data_namespace = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.driver_use_ssl = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.extra_capabilities = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.filter_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.goodness_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.iser_helper = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.iser_ip_address = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.iser_port = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack quobyte-client[87275]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.iser_target_prefix = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_host = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack quobyte-client[87275]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_login = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_mount_options = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_private_key = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_share_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_ssh_port = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.num_shell_tries = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.nvmet_port_id = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.replication_device = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.report_discard_supported = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.reserved_percentage = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.scst_target_driver = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.storage_protocol = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.target_helper = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.target_ip_address = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.target_port = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.target_prefix = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.target_protocol = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.trace_flags = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.use_chap_auth = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_clear = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_clear_size = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] QuobyteHD.volumes_dir = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.ssl = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_notifications.driver = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_notifications.retry = -1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] key_manager.fixed_key = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.barbican_api_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.barbican_endpoint = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.barbican_endpoint_type = public {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.barbican_region_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.cafile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.collect_timing = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.number_of_retries = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.retry_delay = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.send_service_user_token = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.split_loggers = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.tls_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.tls_min_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.verify_ssl = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican.verify_ssl_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.auth_section = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.auth_type = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.cafile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.collect_timing = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.split_loggers = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.tls_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] barbican_service_user.tls_min_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.approle_role_id = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.approle_secret_id = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.auth_method = approle {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.auth_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.kv_mountpoint = secret {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.kv_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.kv_version = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.namespace = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.root_token_id = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.ssl_ca_crt_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.timeout = 60.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.token_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.token_role = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.use_ssl = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 10:47:27 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-2240060b-cb4e-4287-87c9-68cbef056d66 None None] ******************************************************************************** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 10:47:27 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:47:27 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:47:27 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:27 devstack cinder-volume[87271]: INFO cinder.volume.driver [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.volume.driver [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5923080444336, 'free_capacity_gb': 1773.5923080444336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87271) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_db.sqlalchemy.engines [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writer thread running {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.db.api [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Building query based on filter {{(pid=87271) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87271) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:47:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:27 devstack cinder-volume[87271]: INFO cinder.keymgr.migration [None req-daa159de-27bb-4d69-9ab7-e8319dbd57ac None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 10:47:27 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:47:27 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:47:28 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.238s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:47:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Driver initialization completed successfully. Sep 07 10:47:28 devstack cinder-volume[87271]: INFO cinder.manager [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Initiating service 3 cleanup Sep 07 10:47:28 devstack cinder-volume[87271]: INFO cinder.manager [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Service 3 cleanup completed. Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG cinder.service [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Creating RPC server for service cinder-volume {{(pid=87271) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG cinder.service [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87271) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 10:47:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:47:28 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:47:28 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:47:28 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Sep 07 10:47:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:47:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-818cbf60-5df1-4ab2-8738-0fee9a0a6124 None None] Driver post RPC initialization completed successfully. Sep 07 10:47:37 devstack cinder-volume[86969]: DEBUG dbcounter [-] [86969] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:47:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=3 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:47:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:48:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:48:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 6 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:48:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Flow 'volume_create_manager' (c28ab86a-dc3e-4932-a7b5-f660b423ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ef1326-08ed-4197-a737-f390ce1c2d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ef1326-08ed-4197-a737-f390ce1c2d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1850346154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9935b7-3160-453a-a177-f3944f38a5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac4c9d0017419994d0d3b87e1293f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:48:29Z,use_quota=True,user_id='eb43fabf452d4e948a7d3896a991aa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55f6af0-f2f1-4a8e-b008-1e64d2c5955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55f6af0-f2f1-4a8e-b008-1e64d2c5955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742fd127-7efc-4d9b-9a79-644a99981607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742fd127-7efc-4d9b-9a79-644a99981607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9935b7-3160-453a-a177-f3944f38a5b5', 'volume_name': 'volume-cf9935b7-3160-453a-a177-f3944f38a5b5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb8b816-b186-4f3f-bdef-41add1df45bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb8b816-b186-4f3f-bdef-41add1df45bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e41e7fd-dfe6-4ee6-8180-b21547ab46c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:29 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Volume cf9935b7-3160-453a-a177-f3944f38a5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9935b7-3160-453a-a177-f3944f38a5b5', 'volume_size': 1} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1850346154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9935b7-3160-453a-a177-f3944f38a5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac4c9d0017419994d0d3b87e1293f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:48:29Z,use_quota=True,user_id='eb43fabf452d4e948a7d3896a991aa55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Creating volume cf9935b7-3160-453a-a177-f3944f38a5b5 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:48:29 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:48:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:48:29 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 1073741824 Sep 07 10:48:29 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:30 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 1073741824" returned: 0 in 1.384s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:48:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:48:30 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 Sep 07 10:48:30 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:31 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5" returned: 0 in 0.757s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:48:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:48:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:48:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e41e7fd-dfe6-4ee6-8180-b21547ab46c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9935b7-3160-453a-a177-f3944f38a5b5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4fe754-f617-429f-919f-ca4cf33177fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Volume volume-cf9935b7-3160-453a-a177-f3944f38a5b5 (cf9935b7-3160-453a-a177-f3944f38a5b5): created successfully Sep 07 10:48:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4fe754-f617-429f-919f-ca4cf33177fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Flow 'volume_create_manager' (c28ab86a-dc3e-4932-a7b5-f660b423ff42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:48:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fd232025-8ccb-495a-9986-b7ecf85bbff2 tempest-DeleteServersTestJSON-297986995 None] Created volume successfully. Sep 07 10:48:39 devstack cinder-volume[87271]: WARNING py.warnings [req-5030fcd7-3bf3-4956-9a6d-bdfb11cf54af req-63722509-4f11-4311-8d44-c18bef3ebc25 tempest-DeleteServersTestJSON-297986995 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 07 10:48:39 devstack cinder-volume[87271]: .first() Sep 07 10:48:39 devstack cinder-volume[87271]: Sep 07 10:48:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-5030fcd7-3bf3-4956-9a6d-bdfb11cf54af req-63722509-4f11-4311-8d44-c18bef3ebc25 tempest-DeleteServersTestJSON-297986995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:48:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-5030fcd7-3bf3-4956-9a6d-bdfb11cf54af req-63722509-4f11-4311-8d44-c18bef3ebc25 tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:48:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-5030fcd7-3bf3-4956-9a6d-bdfb11cf54af req-63722509-4f11-4311-8d44-c18bef3ebc25 tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:48:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-5030fcd7-3bf3-4956-9a6d-bdfb11cf54af req-63722509-4f11-4311-8d44-c18bef3ebc25 tempest-DeleteServersTestJSON-297986995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-cf9935b7-3160-453a-a177-f3944f38a5b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfed8db7-999a-4149-bc89-c4ed6503187e', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:48:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-5030fcd7-3bf3-4956-9a6d-bdfb11cf54af req-63722509-4f11-4311-8d44-c18bef3ebc25 tempest-DeleteServersTestJSON-297986995 None] attachment_update completed successfully. Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Flow 'volume_create_manager' (3824d8a0-d25d-480a-9dcf-69a4bfa674e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d62da77-d408-47ea-911c-6f1259a918ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d62da77-d408-47ea-911c-6f1259a918ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1946952160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97613f51-5f0f-4f92-8ba9-40db0a39a144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be75964bfefc44d28c63688dd669c9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:48:42Z,use_quota=True,user_id='f9b15f52bd544613b263df8aec89172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f681de-627a-4d7b-a361-f7458dde6de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f681de-627a-4d7b-a361-f7458dde6de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708e0530-e385-491b-80d6-e059dc56dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708e0530-e385-491b-80d6-e059dc56dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97613f51-5f0f-4f92-8ba9-40db0a39a144', 'volume_name': 'volume-97613f51-5f0f-4f92-8ba9-40db0a39a144', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b070b63-e5ee-493b-a542-53719610f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b070b63-e5ee-493b-a542-53719610f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b951c3c5-ac6f-4dbb-9894-7b92d4d2b3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:42 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Volume 97613f51-5f0f-4f92-8ba9-40db0a39a144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97613f51-5f0f-4f92-8ba9-40db0a39a144', 'volume_size': 1} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1946952160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97613f51-5f0f-4f92-8ba9-40db0a39a144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be75964bfefc44d28c63688dd669c9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:48:42Z,use_quota=True,user_id='f9b15f52bd544613b263df8aec89172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Creating volume 97613f51-5f0f-4f92-8ba9-40db0a39a144 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:48:42 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:48:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:48:42 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 1073741824 Sep 07 10:48:42 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:43 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 1073741824" returned: 0 in 1.345s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:48:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:48:43 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 Sep 07 10:48:43 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:44 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144" returned: 0 in 0.389s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:48:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:48:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:48:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b951c3c5-ac6f-4dbb-9894-7b92d4d2b3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97613f51-5f0f-4f92-8ba9-40db0a39a144', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899efd6b-76e1-4eaa-8485-745d440ae0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:48:44 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Volume volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 (97613f51-5f0f-4f92-8ba9-40db0a39a144): created successfully Sep 07 10:48:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899efd6b-76e1-4eaa-8485-745d440ae0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:48:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Flow 'volume_create_manager' (3824d8a0-d25d-480a-9dcf-69a4bfa674e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:48:44 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0ad6239f-3a74-490c-8916-d5225378f34f tempest-ServerRescueNegativeTestJSON-330499837 None] Created volume successfully. Sep 07 10:48:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-da5c1881-7e4f-4764-8729-c06289ebb42f req-584a15a5-0b55-4785-8232-d991131a7688 tempest-DeleteServersTestJSON-297986995 None] Terminate volume connection completed successfully. Sep 07 10:48:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-da5c1881-7e4f-4764-8729-c06289ebb42f req-584a15a5-0b55-4785-8232-d991131a7688 tempest-DeleteServersTestJSON-297986995 None] Deleting attachment cfed8db7-999a-4149-bc89-c4ed6503187e. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:48:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Acquiring lock "cinder-cf9935b7-3160-453a-a177-f3944f38a5b5-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:48:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Lock "cinder-cf9935b7-3160-453a-a177-f3944f38a5b5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:48:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Acquiring lock "cinder-quobyte-cf9935b7-3160-453a-a177-f3944f38a5b5" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:48:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Lock "cinder-quobyte-cf9935b7-3160-453a-a177-f3944f38a5b5" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:48:53 devstack cinder-volume[87271]: INFO oslo.privsep.daemon [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcfndrs0o/privsep.sock'] Sep 07 10:48:54 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcfndrs0o/privsep.sock Sep 07 10:48:54 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 10:48:55 devstack cinder-volume[87271]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 10:48:55 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:55 devstack cinder-volume[87271]: INFO oslo.privsep.daemon [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Spawned new privsep daemon via rootwrap Sep 07 10:48:55 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Accepted privsep connection to /tmp/tmpcfndrs0o/privsep.sock {{(pid=87271) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 10:48:55 devstack cinder-volume[87271]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 10:48:55 devstack cinder-volume[87271]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 10:48:55 devstack cinder-volume[87271]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 10:48:55 devstack cinder-volume[87271]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89121 Sep 07 10:48:55 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c3a9f-6d3e-4b5c-b5c6-f1881b26d77e]: (2,) {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:48:55 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[83915742-7945-43dc-b147-bc8fc2e25f81]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:48:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:48:55 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 Sep 07 10:48:55 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:56 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5" returned: 0 in 0.730s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:48:56 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5 Sep 07 10:48:56 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:56 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf9935b7-3160-453a-a177-f3944f38a5b5" returned: 0 in 0.315s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Lock "cinder-quobyte-cf9935b7-3160-453a-a177-f3944f38a5b5" released by "delete_volume" :: held 2.712s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:48:56 devstack cinder-volume[87271]: WARNING cinder.quota [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:48:56 devstack cinder-volume[87271]: WARNING cinder.quota [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Created reservations ['c549fd05-c172-4ab6-a5a9-8edfc156efbe', '396e0d7b-5a67-4de0-a369-67b331c0f5bb', 'cf8d2d12-1a98-4a5c-8ec1-701ba0dfccf2', '93608ec8-b519-402e-a1a9-5a97a9afd377'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:48:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:48:56 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:48:56 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:48:57 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Sep 07 10:48:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.559s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:48:57 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:48:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Deleted volume successfully. Sep 07 10:48:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-516d7a87-84e0-4d2e-b7ad-8d73ca5e21bf tempest-DeleteServersTestJSON-297986995 None] Lock "cinder-cf9935b7-3160-453a-a177-f3944f38a5b5-delete_volume" released by "delete_volume" :: held 3.706s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Acquiring lock "cinder-97613f51-5f0f-4f92-8ba9-40db0a39a144-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "cinder-97613f51-5f0f-4f92-8ba9-40db0a39a144-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Acquiring lock "cinder-quobyte-97613f51-5f0f-4f92-8ba9-40db0a39a144" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "cinder-quobyte-97613f51-5f0f-4f92-8ba9-40db0a39a144" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[53faf566-4cb8-43e8-9086-f0368b580099]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:03 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 Sep 07 10:49:03 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:03 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144" returned: 0 in 0.393s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:03 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144 Sep 07 10:49:03 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:03 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-97613f51-5f0f-4f92-8ba9-40db0a39a144" returned: 0 in 0.307s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "cinder-quobyte-97613f51-5f0f-4f92-8ba9-40db0a39a144" released by "delete_volume" :: held 0.764s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Created reservations ['e677cf3c-a50a-471b-8b2c-fdc80b5a0c69', '6d79754a-8fda-4c50-a753-594fd6166d09', 'bc62ea49-7a54-44e7-8d32-656b190f5253', '6de7d69d-9b0d-4a24-b24c-4ff9e3486adb'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:49:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:04 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:49:04 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:05 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.715s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:05 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:49:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Deleted volume successfully. Sep 07 10:49:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9f84c02c-b5b2-4bfa-aacb-a7a402e946c0 tempest-ServerRescueNegativeTestJSON-330499837 None] Lock "cinder-97613f51-5f0f-4f92-8ba9-40db0a39a144-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:10 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:49:10 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:10 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.350s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 8 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:49:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:49:14 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:49:15 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Flow 'volume_create_manager' (78682489-b46c-46dd-981c-7a04236bedc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2282c3-7afa-47e8-9705-cc1484ccffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2282c3-7afa-47e8-9705-cc1484ccffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-757492744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb45a979-7523-4158-9b46-5b9ccc02c523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cecee83f5d496e9b399bc6421d8605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:49:16Z,use_quota=True,user_id='c816a4eff4d84d39975f0f776ff4674e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4c80b2-e344-41e1-94cf-f164a1d9a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4c80b2-e344-41e1-94cf-f164a1d9a986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65ada47-9ae7-41f1-a95d-b303dbefcec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65ada47-9ae7-41f1-a95d-b303dbefcec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb45a979-7523-4158-9b46-5b9ccc02c523', 'volume_name': 'volume-bb45a979-7523-4158-9b46-5b9ccc02c523', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f741036-108d-40b1-8aa0-25aaa9ba8597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f741036-108d-40b1-8aa0-25aaa9ba8597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9d46c7-f225-4802-9326-e75781e8088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:16 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Volume bb45a979-7523-4158-9b46-5b9ccc02c523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb45a979-7523-4158-9b46-5b9ccc02c523', 'volume_size': 1} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-757492744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb45a979-7523-4158-9b46-5b9ccc02c523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cecee83f5d496e9b399bc6421d8605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:49:16Z,use_quota=True,user_id='c816a4eff4d84d39975f0f776ff4674e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Creating volume bb45a979-7523-4158-9b46-5b9ccc02c523 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:49:16 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:49:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:16 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 1073741824 Sep 07 10:49:16 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:17 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 1073741824" returned: 0 in 0.662s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:17 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 Sep 07 10:49:17 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:17 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9d46c7-f225-4802-9326-e75781e8088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb45a979-7523-4158-9b46-5b9ccc02c523', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa0c0d-5f68-44dc-bef1-6cb685a0084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:17 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Volume volume-bb45a979-7523-4158-9b46-5b9ccc02c523 (bb45a979-7523-4158-9b46-5b9ccc02c523): created successfully Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa0c0d-5f68-44dc-bef1-6cb685a0084a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Flow 'volume_create_manager' (78682489-b46c-46dd-981c-7a04236bedc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:49:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-31923a29-84ee-4261-8ffe-cf2bcbab29b4 tempest-ServerActionsTestOtherA-775225044 None] Created volume successfully. Sep 07 10:49:27 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:49:27 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:49:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Flow 'volume_create_manager' (42b40d8c-1442-4045-9fb2-dcf18d1cbf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2a2f6a-6e53-4f47-b4ff-56db3ce99664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2a2f6a-6e53-4f47-b4ff-56db3ce99664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2141907647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c88493c-3424-4df3-a7ba-c9fab64db714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3223f49267334b44b919ca9a3ecb40b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:49:45Z,use_quota=True,user_id='97e235cc8b8b4ed7bd74942cfb02e176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b6b1d5-2ebf-4c14-883c-24546c81b7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b6b1d5-2ebf-4c14-883c-24546c81b7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddc8325-2f9c-4853-b4b8-42c06622337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddc8325-2f9c-4853-b4b8-42c06622337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c88493c-3424-4df3-a7ba-c9fab64db714', 'volume_name': 'volume-6c88493c-3424-4df3-a7ba-c9fab64db714', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600cf4f4-2970-4b1e-99d3-be78a43c5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600cf4f4-2970-4b1e-99d3-be78a43c5549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3749eaf-b6b1-4ba0-91dc-57024bf39171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:45 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Volume 6c88493c-3424-4df3-a7ba-c9fab64db714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c88493c-3424-4df3-a7ba-c9fab64db714', 'volume_size': 1} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2141907647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c88493c-3424-4df3-a7ba-c9fab64db714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3223f49267334b44b919ca9a3ecb40b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:49:45Z,use_quota=True,user_id='97e235cc8b8b4ed7bd74942cfb02e176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Creating volume 6c88493c-3424-4df3-a7ba-c9fab64db714 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:49:45 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:49:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:45 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 1073741824 Sep 07 10:49:45 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:46 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 1073741824" returned: 0 in 0.678s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:49:46 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 Sep 07 10:49:46 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:49:46 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714" returned: 0 in 0.343s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3749eaf-b6b1-4ba0-91dc-57024bf39171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c88493c-3424-4df3-a7ba-c9fab64db714', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5974c53f-0973-4d3f-bfe3-1e7b74082f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:49:46 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Volume volume-6c88493c-3424-4df3-a7ba-c9fab64db714 (6c88493c-3424-4df3-a7ba-c9fab64db714): created successfully Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5974c53f-0973-4d3f-bfe3-1e7b74082f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:49:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Flow 'volume_create_manager' (42b40d8c-1442-4045-9fb2-dcf18d1cbf62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:49:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6b91d5b8-cb4d-42eb-9d7f-6a960dd5747a tempest-TaggedAttachmentsTest-1246673685 None] Created volume successfully. Sep 07 10:49:56 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:49:56 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:50:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:50:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:50:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:50:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:10 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:50:10 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:11 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.557s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:50:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:50:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 8 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:50:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:50:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-3e2afcd4-543a-4a5f-85ec-40af569c7907 req-7fdaa617-7515-499c-ae27-f56dfa08dcb6 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-3e2afcd4-543a-4a5f-85ec-40af569c7907 req-7fdaa617-7515-499c-ae27-f56dfa08dcb6 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-3e2afcd4-543a-4a5f-85ec-40af569c7907 req-7fdaa617-7515-499c-ae27-f56dfa08dcb6 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-3e2afcd4-543a-4a5f-85ec-40af569c7907 req-7fdaa617-7515-499c-ae27-f56dfa08dcb6 tempest-ServerActionsTestOtherA-775225044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-bb45a979-7523-4158-9b46-5b9ccc02c523', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4f329e5-aed9-4c6a-86f3-b6d1e3032b36', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:50:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-3e2afcd4-543a-4a5f-85ec-40af569c7907 req-7fdaa617-7515-499c-ae27-f56dfa08dcb6 tempest-ServerActionsTestOtherA-775225044 None] attachment_update completed successfully. Sep 07 10:50:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-7c916b6b-0086-4b34-b0ae-08870f1be9d9 req-bfb32501-a0f0-4dc9-80dc-8fc4b0e66eb3 tempest-ServerActionsTestOtherA-775225044 None] Terminate volume connection completed successfully. Sep 07 10:50:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-7c916b6b-0086-4b34-b0ae-08870f1be9d9 req-bfb32501-a0f0-4dc9-80dc-8fc4b0e66eb3 tempest-ServerActionsTestOtherA-775225044 None] Deleting attachment a4f329e5-aed9-4c6a-86f3-b6d1e3032b36. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:50:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7c916b6b-0086-4b34-b0ae-08870f1be9d9 req-e7425b7c-40c5-4e99-8b31-074c2e489ef5 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7c916b6b-0086-4b34-b0ae-08870f1be9d9 req-e7425b7c-40c5-4e99-8b31-074c2e489ef5 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7c916b6b-0086-4b34-b0ae-08870f1be9d9 req-e7425b7c-40c5-4e99-8b31-074c2e489ef5 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-7c916b6b-0086-4b34-b0ae-08870f1be9d9 req-e7425b7c-40c5-4e99-8b31-074c2e489ef5 tempest-ServerActionsTestOtherA-775225044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-bb45a979-7523-4158-9b46-5b9ccc02c523', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd9c6ed7-d365-41f9-87b5-f3764011ca09', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:50:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-7c916b6b-0086-4b34-b0ae-08870f1be9d9 req-e7425b7c-40c5-4e99-8b31-074c2e489ef5 tempest-ServerActionsTestOtherA-775225044 None] attachment_update completed successfully. Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Flow 'volume_create_manager' (a7796913-7a08-4f14-a8c4-42243aa10ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b91f00f-71a4-479d-bfea-3c76f5260882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b91f00f-71a4-479d-bfea-3c76f5260882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-215342739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565c4177-a072-42d8-9a65-9296cf30aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c83e2f8efd4abd8fbf66146803f4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:50:30Z,use_quota=True,user_id='b9791c6ba2a9465487742218d3adb67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97aa91c9-37ff-458b-9492-c0155f778c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97aa91c9-37ff-458b-9492-c0155f778c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67c6db0-52c8-421d-aaf4-989cfd5674e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67c6db0-52c8-421d-aaf4-989cfd5674e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565c4177-a072-42d8-9a65-9296cf30aa4c', 'volume_name': 'volume-565c4177-a072-42d8-9a65-9296cf30aa4c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ffa48c-692e-4044-bbbf-921d27439f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ffa48c-692e-4044-bbbf-921d27439f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfdeb78-4e03-4fbd-95cf-97862b8283a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:29 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Volume 565c4177-a072-42d8-9a65-9296cf30aa4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565c4177-a072-42d8-9a65-9296cf30aa4c', 'volume_size': 1} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-215342739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565c4177-a072-42d8-9a65-9296cf30aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c83e2f8efd4abd8fbf66146803f4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:50:30Z,use_quota=True,user_id='b9791c6ba2a9465487742218d3adb67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Creating volume 565c4177-a072-42d8-9a65-9296cf30aa4c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:50:29 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:50:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:29 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c 1073741824 Sep 07 10:50:29 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:30 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c 1073741824" returned: 0 in 0.666s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:30 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c Sep 07 10:50:30 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:30 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c" returned: 0 in 0.316s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfdeb78-4e03-4fbd-95cf-97862b8283a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565c4177-a072-42d8-9a65-9296cf30aa4c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274b5da1-7105-4e41-96d2-b1f794f766ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:30 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Volume volume-565c4177-a072-42d8-9a65-9296cf30aa4c (565c4177-a072-42d8-9a65-9296cf30aa4c): created successfully Sep 07 10:50:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274b5da1-7105-4e41-96d2-b1f794f766ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Flow 'volume_create_manager' (a7796913-7a08-4f14-a8c4-42243aa10ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:50:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6ad801b2-f36d-41ba-9bbf-2959b2f1d097 tempest-VolumesAdminNegativeTest-810929497 None] Created volume successfully. Sep 07 10:50:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Acquiring lock "cinder-565c4177-a072-42d8-9a65-9296cf30aa4c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:50:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Lock "cinder-565c4177-a072-42d8-9a65-9296cf30aa4c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:50:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Acquiring lock "cinder-quobyte-565c4177-a072-42d8-9a65-9296cf30aa4c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:50:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Lock "cinder-quobyte-565c4177-a072-42d8-9a65-9296cf30aa4c" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:50:32 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[41888e55-9ac2-4483-be54-137062d9d4de]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:50:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:33 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c Sep 07 10:50:33 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:33 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c" returned: 0 in 0.704s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:33 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c Sep 07 10:50:33 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:33 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-565c4177-a072-42d8-9a65-9296cf30aa4c" returned: 0 in 0.453s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Lock "cinder-quobyte-565c4177-a072-42d8-9a65-9296cf30aa4c" released by "delete_volume" :: held 1.241s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Created reservations ['b39e323a-e811-44c4-921b-26434e28bedf', '33926ef4-23c9-4511-9cb5-cfc760839466', 'f7af79bd-0036-4db6-94fa-6e13c1864bce', '71050b70-f5ec-4414-b345-574fb2cf3959'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Flow 'volume_create_manager' (46f7504a-1ae0-4457-b40b-151024045346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae295a8-a232-4020-b5d3-dedec2f1eb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae295a8-a232-4020-b5d3-dedec2f1eb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-728105572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657dbc31-f301-4711-9e6f-f53876db532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1770711a17444e16a557f71f6cf48c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:50:34Z,use_quota=True,user_id='ddd281c994054995bfdc52c61bf1d7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e3e0a8-ee54-4c72-9aee-af303c9f3fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e3e0a8-ee54-4c72-9aee-af303c9f3fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292a7a90-c066-4b24-822f-10cce51adde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292a7a90-c066-4b24-822f-10cce51adde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657dbc31-f301-4711-9e6f-f53876db532b', 'volume_name': 'volume-657dbc31-f301-4711-9e6f-f53876db532b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feac0342-d6b2-4bcd-b819-aa23dd5926e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feac0342-d6b2-4bcd-b819-aa23dd5926e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58bda19-a8af-4c62-80fd-5bf8f0811f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:34 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Volume 657dbc31-f301-4711-9e6f-f53876db532b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657dbc31-f301-4711-9e6f-f53876db532b', 'volume_size': 1} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-728105572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657dbc31-f301-4711-9e6f-f53876db532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1770711a17444e16a557f71f6cf48c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:50:34Z,use_quota=True,user_id='ddd281c994054995bfdc52c61bf1d7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Creating volume 657dbc31-f301-4711-9e6f-f53876db532b {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:50:34 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:34 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b 1073741824 Sep 07 10:50:34 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:34 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:50:34 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:34 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.633s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:50:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Deleted volume successfully. Sep 07 10:50:35 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b 1073741824" returned: 0 in 0.877s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13945600-727e-4657-9132-e3b0f142b905 tempest-VolumesAdminNegativeTest-810929497 None] Lock "cinder-565c4177-a072-42d8-9a65-9296cf30aa4c-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:35 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b Sep 07 10:50:35 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:50:35 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b" returned: 0 in 0.455s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58bda19-a8af-4c62-80fd-5bf8f0811f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657dbc31-f301-4711-9e6f-f53876db532b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ecc61-30d3-4dcd-b4d8-8fc305585194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:50:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Volume volume-657dbc31-f301-4711-9e6f-f53876db532b (657dbc31-f301-4711-9e6f-f53876db532b): created successfully Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ecc61-30d3-4dcd-b4d8-8fc305585194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:50:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Flow 'volume_create_manager' (46f7504a-1ae0-4457-b40b-151024045346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:50:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c9baa608-8c15-474b-b062-6fbd6c7b9784 tempest-AttachVolumeShelveTestJSON-1885564405 None] Created volume successfully. Sep 07 10:50:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-52b7e15f-df91-4a9d-b5b3-152f379da98b req-555f6c79-35c5-497a-a513-4b8ce9af2b7f tempest-TaggedAttachmentsTest-1246673685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:50:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-52b7e15f-df91-4a9d-b5b3-152f379da98b req-555f6c79-35c5-497a-a513-4b8ce9af2b7f tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:50:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-52b7e15f-df91-4a9d-b5b3-152f379da98b req-555f6c79-35c5-497a-a513-4b8ce9af2b7f tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:50:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-52b7e15f-df91-4a9d-b5b3-152f379da98b req-555f6c79-35c5-497a-a513-4b8ce9af2b7f tempest-TaggedAttachmentsTest-1246673685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-6c88493c-3424-4df3-a7ba-c9fab64db714', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0602666d-ae75-496c-a3ca-ff521a2ad8ff', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:50:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-52b7e15f-df91-4a9d-b5b3-152f379da98b req-555f6c79-35c5-497a-a513-4b8ce9af2b7f tempest-TaggedAttachmentsTest-1246673685 None] attachment_update completed successfully. Sep 07 10:50:45 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-78d5701f-f385-4479-8e65-c95f2aaa66db req-e0c097b5-e10b-4032-8b06-a0745b90bd6b tempest-TaggedAttachmentsTest-1246673685 None] Terminate volume connection completed successfully. Sep 07 10:50:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-78d5701f-f385-4479-8e65-c95f2aaa66db req-e0c097b5-e10b-4032-8b06-a0745b90bd6b tempest-TaggedAttachmentsTest-1246673685 None] Deleting attachment 0602666d-ae75-496c-a3ca-ff521a2ad8ff. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:50:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-883485ff-6037-40d3-9617-3fde34259bf4 req-afdd5e2f-d105-441b-b9da-263d796f7b1f tempest-AttachVolumeShelveTestJSON-1885564405 None] No connector for attachment e5d85764-afc3-458c-957f-2b0d5bd2af3d; skipping storage backend terminate_connection call. {{(pid=87271) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 10:50:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-883485ff-6037-40d3-9617-3fde34259bf4 req-afdd5e2f-d105-441b-b9da-263d796f7b1f tempest-AttachVolumeShelveTestJSON-1885564405 None] Deleting attachment e5d85764-afc3-458c-957f-2b0d5bd2af3d. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:50:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-5cd8f92f-6863-44c3-b0ab-4b3ddc9aa592 req-517fff7f-85f7-4084-80fd-b13808fcdcdb tempest-ServerActionsTestOtherA-775225044 None] Terminate volume connection completed successfully. Sep 07 10:50:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-5cd8f92f-6863-44c3-b0ab-4b3ddc9aa592 req-517fff7f-85f7-4084-80fd-b13808fcdcdb tempest-ServerActionsTestOtherA-775225044 None] Deleting attachment dd9c6ed7-d365-41f9-87b5-f3764011ca09. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:50:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Acquiring lock "cinder-6c88493c-3424-4df3-a7ba-c9fab64db714-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:50:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Lock "cinder-6c88493c-3424-4df3-a7ba-c9fab64db714-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:50:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Acquiring lock "cinder-quobyte-6c88493c-3424-4df3-a7ba-c9fab64db714" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:50:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Lock "cinder-quobyte-6c88493c-3424-4df3-a7ba-c9fab64db714" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:50:59 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a9af3b-a509-4536-b44d-7c8c29dfef8a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:50:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:50:59 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 Sep 07 10:50:59 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:00 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714" returned: 0 in 0.596s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:00 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714 Sep 07 10:51:00 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:00 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6c88493c-3424-4df3-a7ba-c9fab64db714" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Lock "cinder-quobyte-6c88493c-3424-4df3-a7ba-c9fab64db714" released by "delete_volume" :: held 1.044s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Created reservations ['a5275b6d-fd6c-402c-9f92-e108bf859ef3', '0d279f11-4efa-42cd-9433-66ee5628dd9a', 'fabb5382-21f2-481a-b418-bc7c22ace6f0', '3d050905-cd64-452e-b456-ed9da1911e00'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:51:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:00 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:51:00 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:01 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.384s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:01 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:51:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Deleted volume successfully. Sep 07 10:51:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1183c2f-4ec3-4df2-8960-fd9d6970559c tempest-TaggedAttachmentsTest-1246673685 None] Lock "cinder-6c88493c-3424-4df3-a7ba-c9fab64db714-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:51:01 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:51:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Flow 'volume_create_manager' (c17354de-12b9-469d-8a49-c04c0731b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:51:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb534799-ab89-441b-8cd0-1ee7eb22bfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:51:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb534799-ab89-441b-8cd0-1ee7eb22bfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-311532646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294fc758-59d1-479b-81de-c8a5e0b0ceb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cecee83f5d496e9b399bc6421d8605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:51:02Z,use_quota=True,user_id='c816a4eff4d84d39975f0f776ff4674e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:51:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4019f9-ce32-4cf9-a94e-fd621b8a0e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:51:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4019f9-ce32-4cf9-a94e-fd621b8a0e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:51:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58111840-b4e6-463c-bfd7-17e444e26413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:51:02 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58111840-b4e6-463c-bfd7-17e444e26413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '294fc758-59d1-479b-81de-c8a5e0b0ceb9', 'volume_name': 'volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac7b63b-b577-4664-bc0a-1f3b0d653a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac7b63b-b577-4664-bc0a-1f3b0d653a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107922c5-7173-46c9-8fd8-9be409f68782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:51:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Volume 294fc758-59d1-479b-81de-c8a5e0b0ceb9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Trying to clone 294fc758-59d1-479b-81de-c8a5e0b0ceb9 from image 705abe21-5cec-4130-9cb9-f60544709b95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:51:03 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Image download 20.69 MB at 20.69 MB/s Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f22cbb0-9cb1-4855-8df6-37bdd5887a32]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:51:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:03 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD Sep 07 10:51:03 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:04 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD" returned: 0 in 0.561s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 is fetched for user c816a4eff4d84d39975f0f776ff4674e. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7855081c-15f8-4ce0-902b-3c9c569237d1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:04 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD Sep 07 10:51:04 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:04 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-311532646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294fc758-59d1-479b-81de-c8a5e0b0ceb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cecee83f5d496e9b399bc6421d8605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:51:02Z,use_quota=True,user_id='c816a4eff4d84d39975f0f776ff4674e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Creating volume 294fc758-59d1-479b-81de-c8a5e0b0ceb9 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:51:04 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:51:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:04 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 1073741824 Sep 07 10:51:04 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:05 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 1073741824" returned: 0 in 0.858s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:05 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 Sep 07 10:51:05 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:06 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9" returned: 0 in 0.667s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:51:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:51:06 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Attempting download of 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume 294fc758-59d1-479b-81de-c8a5e0b0ceb9. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:51:06 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa78f93-35e8-46a5-ae9e-70cfbf962269]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:51:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_cgzwqvkz {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:06 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_cgzwqvkz Sep 07 10:51:06 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:07 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_cgzwqvkz" returned: 0 in 0.694s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_cgzwqvkz {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:07 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_cgzwqvkz Sep 07 10:51:07 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:07 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_cgzwqvkz" returned: 1 in 0.582s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_cgzwqvkz' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:51:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf50b5-2d3b-4186-a698-469be6e0d690]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:51:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:08 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD Sep 07 10:51:08 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:08 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:08 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] 705abe21-5cec-4130-9cb9-f60544709b95 was qcow2, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:51:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:08 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 Sep 07 10:51:08 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:51:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:51:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:51:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:51:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:51:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:51:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:10 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:51:10 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:11 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.527s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 28 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:51:11 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9" returned: 0 in 3.036s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_j50wzi0jdevstack@QuobyteHD, size 112.00 MB, duration 3.04 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:51:11 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Converted 112.00 MB image at 36.88 MB/s Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:11 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 1G Sep 07 10:51:11 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:11 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 1G" returned: 0 in 0.413s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Downloaded image 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume 294fc758-59d1-479b-81de-c8a5e0b0ceb9 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 for user c816a4eff4d84d39975f0f776ff4674e is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Marking volume 294fc758-59d1-479b-81de-c8a5e0b0ceb9 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=44,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Copying metadata from image 705abe21-5cec-4130-9cb9-f60544709b95 to 294fc758-59d1-479b-81de-c8a5e0b0ceb9. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Creating volume glance metadata for volume 294fc758-59d1-479b-81de-c8a5e0b0ceb9 backed by image 705abe21-5cec-4130-9cb9-f60544709b95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:51:11 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=38,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:51:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107922c5-7173-46c9-8fd8-9be409f68782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:51:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56a888d-2ff8-482b-adb1-294d9a710499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:51:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Volume volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 (294fc758-59d1-479b-81de-c8a5e0b0ceb9): created successfully Sep 07 10:51:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56a888d-2ff8-482b-adb1-294d9a710499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:51:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Flow 'volume_create_manager' (c17354de-12b9-469d-8a49-c04c0731b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:51:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a723ed80-b3f1-4e2f-83aa-f876044dfd7f tempest-ServerActionsTestOtherA-775225044 None] Created volume successfully. Sep 07 10:51:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-2bddf102-9b08-4c60-9824-197d40775192 req-f41d637b-dad5-43fd-87aa-51e038d4f25e tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:51:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-2bddf102-9b08-4c60-9824-197d40775192 req-f41d637b-dad5-43fd-87aa-51e038d4f25e tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:51:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-2bddf102-9b08-4c60-9824-197d40775192 req-f41d637b-dad5-43fd-87aa-51e038d4f25e tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:51:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-2bddf102-9b08-4c60-9824-197d40775192 req-f41d637b-dad5-43fd-87aa-51e038d4f25e tempest-ServerActionsTestOtherA-775225044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7f4d97c-73ad-46fe-963a-5e68ff821517', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:51:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-2bddf102-9b08-4c60-9824-197d40775192 req-f41d637b-dad5-43fd-87aa-51e038d4f25e tempest-ServerActionsTestOtherA-775225044 None] attachment_update completed successfully. Sep 07 10:51:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:INSERT=6,cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:51:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=4 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:51:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Acquiring lock "cinder-657dbc31-f301-4711-9e6f-f53876db532b-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:51:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "cinder-657dbc31-f301-4711-9e6f-f53876db532b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:51:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Acquiring lock "cinder-quobyte-657dbc31-f301-4711-9e6f-f53876db532b" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:51:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "cinder-quobyte-657dbc31-f301-4711-9e6f-f53876db532b" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:51:45 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18d3144-5186-47ef-ab69-7435b69c78eb]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:51:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:45 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b Sep 07 10:51:45 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:46 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b" returned: 0 in 0.802s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:46 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b Sep 07 10:51:46 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:46 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-657dbc31-f301-4711-9e6f-f53876db532b" returned: 0 in 0.491s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "cinder-quobyte-657dbc31-f301-4711-9e6f-f53876db532b" released by "delete_volume" :: held 1.375s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Created reservations ['27e5ab60-888f-49ad-8d94-ecc289692a71', '3b85a69f-6cd5-46a3-84a6-f760d10990a6', '0b660515-f92d-4428-9d81-4645f6cfc8f2', 'f3d5a9e3-c217-4f0d-9bc2-a4f218dd6d52'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:51:47 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:51:47 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:51:47 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.375s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:51:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Deleted volume successfully. Sep 07 10:51:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-246a86c6-00fb-4d20-b775-507270f01ba8 tempest-AttachVolumeShelveTestJSON-1885564405 None] Lock "cinder-657dbc31-f301-4711-9e6f-f53876db532b-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:51:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-93668c91-1295-48c4-8a06-b3a795e79e7e req-328cf6f7-7000-4dfd-be6a-cd63a68f67aa tempest-ServerActionsTestOtherA-775225044 None] Terminate volume connection completed successfully. Sep 07 10:51:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-93668c91-1295-48c4-8a06-b3a795e79e7e req-328cf6f7-7000-4dfd-be6a-cd63a68f67aa tempest-ServerActionsTestOtherA-775225044 None] Deleting attachment c7f4d97c-73ad-46fe-963a-5e68ff821517. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:51:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-93668c91-1295-48c4-8a06-b3a795e79e7e req-19a76f28-fc2b-4702-ac09-e8f2f70f3a5a tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:51:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-93668c91-1295-48c4-8a06-b3a795e79e7e req-19a76f28-fc2b-4702-ac09-e8f2f70f3a5a tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:51:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-93668c91-1295-48c4-8a06-b3a795e79e7e req-19a76f28-fc2b-4702-ac09-e8f2f70f3a5a tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:51:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-93668c91-1295-48c4-8a06-b3a795e79e7e req-19a76f28-fc2b-4702-ac09-e8f2f70f3a5a tempest-ServerActionsTestOtherA-775225044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83d0b3d1-44cd-4721-9641-86a9b18826dd', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:51:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-93668c91-1295-48c4-8a06-b3a795e79e7e req-19a76f28-fc2b-4702-ac09-e8f2f70f3a5a tempest-ServerActionsTestOtherA-775225044 None] attachment_update completed successfully. Sep 07 10:52:05 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=11,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:52:05 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=16,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:52:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:52:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:10 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:10 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:11 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.600s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:11 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:52:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Flow 'volume_create_manager' (bd280df3-678a-4906-a393-25edfa7d0f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fd8294-8d8f-4dd3-8389-f2a8d2bc0ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fd8294-8d8f-4dd3-8389-f2a8d2bc0ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1285804496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d8528a-342a-4ab2-acf4-a925e97b51c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fe921bf7e44f028128eb2e617e06e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:12Z,use_quota=True,user_id='d43581dbffbe4a8da1679038c8d55020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20101b74-12a1-41b5-98cc-1a0442ca1fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20101b74-12a1-41b5-98cc-1a0442ca1fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88094dc6-0e5c-4b3a-957f-f7b51133c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88094dc6-0e5c-4b3a-957f-f7b51133c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d8528a-342a-4ab2-acf4-a925e97b51c3', 'volume_name': 'volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a199d91e-7832-413b-8c95-09669ef32932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a199d91e-7832-413b-8c95-09669ef32932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cfa3f6-2e8c-454b-8ddb-d6a9664e7114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Volume e3d8528a-342a-4ab2-acf4-a925e97b51c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3', 'volume_size': 1} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1285804496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d8528a-342a-4ab2-acf4-a925e97b51c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fe921bf7e44f028128eb2e617e06e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:12Z,use_quota=True,user_id='d43581dbffbe4a8da1679038c8d55020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Creating volume e3d8528a-342a-4ab2-acf4-a925e97b51c3 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:52:12 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:52:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:12 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 1073741824 Sep 07 10:52:12 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:13 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 1073741824" returned: 0 in 1.121s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:13 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 Sep 07 10:52:13 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:13 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3" returned: 0 in 0.395s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cfa3f6-2e8c-454b-8ddb-d6a9664e7114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84eb382-6d73-4c4d-beab-91f63cef17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:13 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Volume volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 (e3d8528a-342a-4ab2-acf4-a925e97b51c3): created successfully Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84eb382-6d73-4c4d-beab-91f63cef17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Flow 'volume_create_manager' (bd280df3-678a-4906-a393-25edfa7d0f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-027e8690-df1e-4cc5-9a21-5a2ae595b03c tempest-AttachVolumeTestJSON-390571070 None] Created volume successfully. Sep 07 10:52:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-c15cd176-c51a-4447-8453-222394375884 req-eb221839-304c-4a43-98ce-7ef11848fa46 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-c15cd176-c51a-4447-8453-222394375884 req-eb221839-304c-4a43-98ce-7ef11848fa46 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-c15cd176-c51a-4447-8453-222394375884 req-eb221839-304c-4a43-98ce-7ef11848fa46 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-c15cd176-c51a-4447-8453-222394375884 req-eb221839-304c-4a43-98ce-7ef11848fa46 tempest-AttachVolumeTestJSON-390571070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae5bfe67-d86d-4b9e-a8ad-d02d8a97ebe9', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:52:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-c15cd176-c51a-4447-8453-222394375884 req-eb221839-304c-4a43-98ce-7ef11848fa46 tempest-AttachVolumeTestJSON-390571070 None] attachment_update completed successfully. Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Flow 'volume_create_manager' (e0aeec41-f266-4251-8304-aa2a322fd1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780d8981-e73e-4f35-aa04-904387c6365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780d8981-e73e-4f35-aa04-904387c6365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2024209190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a26836c-bbad-4681-bf23-b565eea81ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b2a835103d4587962e8440b25b6151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:19Z,use_quota=True,user_id='9b15f9304f26447cbea35f620cbc35f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c34273-e2ee-4f51-b342-978e2f3666ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c34273-e2ee-4f51-b342-978e2f3666ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d959af-a7f7-44e6-9e96-c484e0749645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d959af-a7f7-44e6-9e96-c484e0749645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a26836c-bbad-4681-bf23-b565eea81ca3', 'volume_name': 'volume-1a26836c-bbad-4681-bf23-b565eea81ca3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5f76da-ed12-4e68-9436-090582b26e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5f76da-ed12-4e68-9436-090582b26e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6488d018-7624-43ab-827e-1d0fd6898a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Volume 1a26836c-bbad-4681-bf23-b565eea81ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a26836c-bbad-4681-bf23-b565eea81ca3', 'volume_size': 1} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2024209190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a26836c-bbad-4681-bf23-b565eea81ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b2a835103d4587962e8440b25b6151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:19Z,use_quota=True,user_id='9b15f9304f26447cbea35f620cbc35f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Creating volume 1a26836c-bbad-4681-bf23-b565eea81ca3 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:52:19 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:19 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 1073741824 Sep 07 10:52:19 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:19 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 1073741824" returned: 0 in 0.540s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:19 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 Sep 07 10:52:19 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:20 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3" returned: 0 in 0.514s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:52:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6488d018-7624-43ab-827e-1d0fd6898a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a26836c-bbad-4681-bf23-b565eea81ca3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725735ae-61e2-4019-b874-7714eba21e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:20 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Volume volume-1a26836c-bbad-4681-bf23-b565eea81ca3 (1a26836c-bbad-4681-bf23-b565eea81ca3): created successfully Sep 07 10:52:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725735ae-61e2-4019-b874-7714eba21e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Flow 'volume_create_manager' (e0aeec41-f266-4251-8304-aa2a322fd1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8f8f827b-55d4-495a-98a2-6c12168e31f1 tempest-ServersNegativeTestJSON-1890471861 None] Created volume successfully. Sep 07 10:52:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1b54f65e-6dc0-4294-ae8b-c30850cc527c tempest-GroupsV314Test-365363546 None] Group tempest-GroupsV314Test-Group-1398067835: creating Sep 07 10:52:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1b54f65e-6dc0-4294-ae8b-c30850cc527c tempest-GroupsV314Test-365363546 None] Group tempest-GroupsV314Test-Group-1398067835: created successfully Sep 07 10:52:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1b54f65e-6dc0-4294-ae8b-c30850cc527c tempest-GroupsV314Test-365363546 None] Create group completed successfully. Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Flow 'volume_create_manager' (3a4add4d-aba3-4a59-8f31-1616cbe499d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3d8ae9-d10e-45b3-8daa-6abd75f03c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3d8ae9-d10e-45b3-8daa-6abd75f03c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252393823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e12a58e-c938-4048-84b1-3ddbd7893641,host='devstack@QuobyteHD#QuobyteHD',id=34a41075-2ce7-478f-9d5f-3a42d41546e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6308b355fe4cf588e01a5564392ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:24Z,use_quota=True,user_id='01306bcb5cf24ac9bbea7207179603ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e79fd0-8292-4a76-9677-62d89608fcd7),volume_type_id=05e79fd0-8292-4a76-9677-62d89608fcd7)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17894d76-9b5e-442e-815b-45548eccbd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17894d76-9b5e-442e-815b-45548eccbd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67541db-d0ff-4e00-8e18-979acaa4415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67541db-d0ff-4e00-8e18-979acaa4415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a41075-2ce7-478f-9d5f-3a42d41546e4', 'volume_name': 'volume-34a41075-2ce7-478f-9d5f-3a42d41546e4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b8d623-02d6-45b4-a4ba-dd8ac2e8b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b8d623-02d6-45b4-a4ba-dd8ac2e8b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1085782-c634-4d5a-aed5-e79187fa91f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:23 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Volume 34a41075-2ce7-478f-9d5f-3a42d41546e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a41075-2ce7-478f-9d5f-3a42d41546e4', 'volume_size': 1} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e12a58e-c938-4048-84b1-3ddbd7893641,created_at=2026-09-07T08:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252393823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e12a58e-c938-4048-84b1-3ddbd7893641,host='devstack@QuobyteHD#QuobyteHD',id=34a41075-2ce7-478f-9d5f-3a42d41546e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6308b355fe4cf588e01a5564392ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:24Z,use_quota=True,user_id='01306bcb5cf24ac9bbea7207179603ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e79fd0-8292-4a76-9677-62d89608fcd7),volume_type_id=05e79fd0-8292-4a76-9677-62d89608fcd7)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Creating volume 34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:52:23 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:52:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:23 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 1073741824 Sep 07 10:52:23 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:24 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 1073741824" returned: 0 in 0.649s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:24 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 Sep 07 10:52:24 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Flow 'volume_create_manager' (2733d1b7-d250-4667-8a6b-be5d6d505bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab0f632-653f-4be6-8976-d9ee48ae381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab0f632-653f-4be6-8976-d9ee48ae381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-75615435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d918d078-2feb-4ee7-a1ca-aa172e125f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b2a835103d4587962e8440b25b6151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:25Z,use_quota=True,user_id='9b15f9304f26447cbea35f620cbc35f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c8cd27-2beb-444d-9036-83a101c5a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c8cd27-2beb-444d-9036-83a101c5a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff952e87-218b-4d51-818b-03d1a1282498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff952e87-218b-4d51-818b-03d1a1282498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd918d078-2feb-4ee7-a1ca-aa172e125f7e', 'volume_name': 'volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d05343-62e9-4bbb-b5c9-bd3b6d43c350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d05343-62e9-4bbb-b5c9-bd3b6d43c350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d486fabf-1422-4528-b5b8-d5a4173ec979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Volume d918d078-2feb-4ee7-a1ca-aa172e125f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e', 'volume_size': 1} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:24 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4" returned: 0 in 0.267s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-75615435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d918d078-2feb-4ee7-a1ca-aa172e125f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b2a835103d4587962e8440b25b6151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:25Z,use_quota=True,user_id='9b15f9304f26447cbea35f620cbc35f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Creating volume d918d078-2feb-4ee7-a1ca-aa172e125f7e {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:52:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1085782-c634-4d5a-aed5-e79187fa91f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a41075-2ce7-478f-9d5f-3a42d41546e4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:24 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e 1073741824 Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28f5199-cddc-4581-8d53-ef19d09c81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:24 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Volume volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 (34a41075-2ce7-478f-9d5f-3a42d41546e4): created successfully Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28f5199-cddc-4581-8d53-ef19d09c81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Flow 'volume_create_manager' (3a4add4d-aba3-4a59-8f31-1616cbe499d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-565437b0-56de-4129-85da-21f1b10be359 tempest-GroupsV314Test-365363546 None] Created volume successfully. Sep 07 10:52:25 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e 1073741824" returned: 0 in 0.609s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:25 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e Sep 07 10:52:25 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:25 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e" returned: 0 in 0.256s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d486fabf-1422-4528-b5b8-d5a4173ec979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5770ba4-3c74-47d6-95af-1607ecf39ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Volume volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e (d918d078-2feb-4ee7-a1ca-aa172e125f7e): created successfully Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5770ba4-3c74-47d6-95af-1607ecf39ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Flow 'volume_create_manager' (2733d1b7-d250-4667-8a6b-be5d6d505bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2a8503e9-ab23-436e-bb46-1d1d5c935e03 tempest-ServersNegativeTestJSON-1890471861 None] Created volume successfully. Sep 07 10:52:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:26 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Cloning volume 34a41075-2ce7-478f-9d5f-3a42d41546e4 to volume e9b0dd21-6f81-4162-96cc-2f6d9b989a5a Sep 07 10:52:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Creating offline snapshot 967782b4-6e86-4325-b613-218029763226 of volume 34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:52:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "cinder-d918d078-2feb-4ee7-a1ca-aa172e125f7e-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbebddf-4f18-4cfd-b81c-2e4739192491]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-d918d078-2feb-4ee7-a1ca-aa172e125f7e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "cinder-quobyte-d918d078-2feb-4ee7-a1ca-aa172e125f7e" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-quobyte-d918d078-2feb-4ee7-a1ca-aa172e125f7e" acquired by "delete_volume" :: waited 0.033s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:27 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 Sep 07 10:52:27 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d69def0-4933-4c1b-9010-ca2f22c9c6e2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:27 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e Sep 07 10:52:27 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:27 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4" returned: 0 in 0.580s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:27 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 1G Sep 07 10:52:27 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:27 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e" returned: 0 in 0.500s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:27 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e Sep 07 10:52:27 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:27 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d918d078-2feb-4ee7-a1ca-aa172e125f7e" returned: 0 in 0.290s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-quobyte-d918d078-2feb-4ee7-a1ca-aa172e125f7e" released by "delete_volume" :: held 0.837s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Created reservations ['baaa8830-8a9a-4145-8a44-6a773ff1d97d', '593d649e-e969-45c8-8c6f-b35fe6c57f9a', 'e0361657-a8cc-4f83-ba90-bc3a3186df19', '1e87aa6e-aaed-47a6-b6f1-4f3ec9171b98'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:28 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:28 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:28 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 1G" returned: 0 in 0.649s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "cinder-1a26836c-bbad-4681-bf23-b565eea81ca3-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:28 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 Sep 07 10:52:28 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-1a26836c-bbad-4681-bf23-b565eea81ca3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "cinder-quobyte-1a26836c-bbad-4681-bf23-b565eea81ca3" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-quobyte-1a26836c-bbad-4681-bf23-b565eea81ca3" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78617d1-3e92-436d-8370-cdbb9e741f7f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:28 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 Sep 07 10:52:28 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:28 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.642s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Deleted volume successfully. Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bbeb723a-d0ab-47d1-a530-5cef2c098893 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-d918d078-2feb-4ee7-a1ca-aa172e125f7e-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:28 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226" returned: 0 in 0.644s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:28 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:52:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:28 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 Sep 07 10:52:28 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:29 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3" returned: 0 in 0.729s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:29 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226" returned: 0 in 0.387s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:29 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3 Sep 07 10:52:29 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:29 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.info Sep 07 10:52:29 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:29 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a26836c-bbad-4681-bf23-b565eea81ca3" returned: 0 in 0.502s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-quobyte-1a26836c-bbad-4681-bf23-b565eea81ca3" released by "delete_volume" :: held 1.324s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Created reservations ['5b6ddbea-36bc-409f-a8af-755c19c8f419', '2e43d4d9-7461-4b11-9848-b0804e08571b', '7ce4f75b-1c4d-4fc0-a185-a79a61394031', '65f5e94b-ad82-477d-9191-bd663623a518'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:29 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.info" returned: 0 in 0.637s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:29 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:52:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:30 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.info Sep 07 10:52:30 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:30 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:30 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:30 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.info" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Acquiring lock "cinder-quobyte-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] snapshot: 967782b4-6e86-4325-b613-218029763226, volume: e9b0dd21-6f81-4162-96cc-2f6d9b989a5a, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37582ae-807d-467c-804b-90beebdc4a26]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:30 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.452s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:30 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Deleted volume successfully. Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6d88a5f-5891-47da-b935-fc28ec6a4ab2 tempest-ServersNegativeTestJSON-1890471861 None] Lock "cinder-1a26836c-bbad-4681-bf23-b565eea81ca3-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:30 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 Sep 07 10:52:30 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:30 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226" returned: 0 in 0.551s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34a41075-2ce7-478f-9d5f-3a42d41546e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:52:31 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8e3c8-4137-4ada-8025-f936026e1c40]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:31 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 Sep 07 10:52:31 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:31 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4" returned: 0 in 0.785s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:52:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:52:31 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:52:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:31 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a Sep 07 10:52:31 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:37 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" returned: 0 in 6.183s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:37 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:52:38 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Converted 1024.00 MB image at 165.59 MB/s Sep 07 10:52:38 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:38 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a Sep 07 10:52:38 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:38 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" released by "_copy_volume_from_snapshot" :: held 7.901s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Acquiring lock "cinder-quobyte-967782b4-6e86-4325-b613-218029763226" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-967782b4-6e86-4325-b613-218029763226" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Deleting offline snapshot 967782b4-6e86-4325-b613-218029763226 of volume 34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] snapshot_file for this snap is: volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01689c1-1ddc-4502-ab2b-dd2158c58741]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:38 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 Sep 07 10:52:38 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:38 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226" returned: 0 in 0.450s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34a41075-2ce7-478f-9d5f-3a42d41546e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e8586-186a-4c8f-93f3-cd7b888c946a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:38 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 Sep 07 10:52:38 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:39 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4" returned: 0 in 0.583s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:39 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 Sep 07 10:52:39 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:39 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226" returned: 0 in 0.445s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:39 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226 Sep 07 10:52:39 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:40 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4.967782b4-6e86-4325-b613-218029763226" returned: 0 in 0.258s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-967782b4-6e86-4325-b613-218029763226" released by "_delete_snapshot" :: held 1.848s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.316s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:40 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4cc52a0b-aa9c-48ab-9182-54aca38a7f0c tempest-GroupsV314Test-365363546 None] Create group from source-group-1e12a58e-c938-4048-84b1-3ddbd7893641 completed successfully. Sep 07 10:52:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Acquiring lock "cinder-quobyte-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:40 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b27a6-8ec3-45a9-87c2-3a6f2055a4d0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:41 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a Sep 07 10:52:41 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:41 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" returned: 0 in 0.382s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:41 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a Sep 07 10:52:41 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:41 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" returned: 0 in 0.282s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-e9b0dd21-6f81-4162-96cc-2f6d9b989a5a" released by "delete_volume" :: held 0.718s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Created reservations ['55424784-6140-4200-aaa9-692591be6917'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:41 devstack cinder-volume[87271]: WARNING cinder.quota [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1481108783 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1481108783, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:52:41 devstack cinder-volume[87271]: WARNING cinder.quota [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1481108783 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1481108783, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Created reservations ['4721a492-bc73-44e8-8e24-361e144f5fda', 'e8981743-463c-4baf-b847-0564c7f78cdb', '56d4e37e-cb25-4151-9f5a-cad6faa4ac0b', 'f18534da-6831-4afc-ac17-58a8daf0c991'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:41 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:41 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:42 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.287s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b639805a-a76f-4ae8-a159-46ee36e935a0 tempest-GroupsV314Test-365363546 None] Delete group completed successfully. Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Acquiring lock "cinder-quobyte-34a41075-2ce7-478f-9d5f-3a42d41546e4" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-34a41075-2ce7-478f-9d5f-3a42d41546e4" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e260d160-cd48-4100-920e-a683bcd006f2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:42 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 Sep 07 10:52:42 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:42 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:42 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4 Sep 07 10:52:42 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:43 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34a41075-2ce7-478f-9d5f-3a42d41546e4" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Lock "cinder-quobyte-34a41075-2ce7-478f-9d5f-3a42d41546e4" released by "delete_volume" :: held 0.709s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Created reservations ['050e469a-e86b-470b-b9ae-29728c0868e5'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Created reservations ['ff0dc1ab-40b0-4f23-a6e9-76dbb6a30efa', 'f7a8fdf7-15cd-4cec-845f-c781f9ecbbc8', '138140ee-46dd-43b2-95dc-1081303b403b', 'a24a2b55-cf35-4c13-b3cb-cdc00d470af8'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:43 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:43 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:43 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.253s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:43 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-adf5d466-02f7-46d6-aeaf-c3b9898b732b tempest-GroupsV314Test-365363546 None] Delete group completed successfully. Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Flow 'volume_create_manager' (d07df9dd-f815-45f7-8d50-5a4ef789c2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1d4767-01b4-4009-b258-7f8313a5350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1d4767-01b4-4009-b258-7f8313a5350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-871457232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb42ed8-19da-4b83-8fab-ff1850c22770,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b0f3945fd0d478295b7d35d755ad911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:45Z,use_quota=True,user_id='f367636f47d0497d977ca1a765b13741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f0aef3-0a88-4be8-a3ae-d2a2906884c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f0aef3-0a88-4be8-a3ae-d2a2906884c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9f14ed-c789-4b2a-88f6-766d95a6550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9f14ed-c789-4b2a-88f6-766d95a6550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb42ed8-19da-4b83-8fab-ff1850c22770', 'volume_name': 'volume-8fb42ed8-19da-4b83-8fab-ff1850c22770', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cdd7d6-a689-4287-9be4-5107f70f7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cdd7d6-a689-4287-9be4-5107f70f7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114a030e-39e2-4b78-84ca-da4f9e3a8164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:45 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Volume 8fb42ed8-19da-4b83-8fab-ff1850c22770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb42ed8-19da-4b83-8fab-ff1850c22770', 'volume_size': 1} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-871457232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb42ed8-19da-4b83-8fab-ff1850c22770,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b0f3945fd0d478295b7d35d755ad911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:52:45Z,use_quota=True,user_id='f367636f47d0497d977ca1a765b13741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Creating volume 8fb42ed8-19da-4b83-8fab-ff1850c22770 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:52:45 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:52:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:45 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 1073741824 Sep 07 10:52:45 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:46 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 1073741824" returned: 0 in 0.601s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:46 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 Sep 07 10:52:46 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:46 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770" returned: 0 in 0.376s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114a030e-39e2-4b78-84ca-da4f9e3a8164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb42ed8-19da-4b83-8fab-ff1850c22770', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe432065-a18c-41c4-9ac7-e2bcfc32ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:52:46 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Volume volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 (8fb42ed8-19da-4b83-8fab-ff1850c22770): created successfully Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe432065-a18c-41c4-9ac7-e2bcfc32ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:52:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Flow 'volume_create_manager' (d07df9dd-f815-45f7-8d50-5a4ef789c2b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:52:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-4fa40fc3-43a3-4849-8fa7-adaebdc75a02 req-4c0459d6-4c03-447d-b0c8-e792074f761f tempest-VolumesGetTestJSON-1646915907 None] Created volume successfully. Sep 07 10:52:48 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5854f306-5a79-4893-9ccf-376dcc1eac54 tempest-ServerActionsTestOtherA-775225044 None] Terminate volume connection completed successfully. Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5854f306-5a79-4893-9ccf-376dcc1eac54 tempest-ServerActionsTestOtherA-775225044 None] Deleting attachment 83d0b3d1-44cd-4721-9641-86a9b18826dd. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "cinder-294fc758-59d1-479b-81de-c8a5e0b0ceb9-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-294fc758-59d1-479b-81de-c8a5e0b0ceb9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "cinder-quobyte-294fc758-59d1-479b-81de-c8a5e0b0ceb9" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-quobyte-294fc758-59d1-479b-81de-c8a5e0b0ceb9" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de72634-b19d-4670-bdee-0eb5d112ea3f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Acquiring lock "cinder-8fb42ed8-19da-4b83-8fab-ff1850c22770-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Lock "cinder-8fb42ed8-19da-4b83-8fab-ff1850c22770-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Acquiring lock "cinder-quobyte-8fb42ed8-19da-4b83-8fab-ff1850c22770" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Lock "cinder-quobyte-8fb42ed8-19da-4b83-8fab-ff1850c22770" acquired by "delete_volume" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:48 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 Sep 07 10:52:48 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df4e82-7d8f-4464-a787-a26fd84d134f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:48 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 Sep 07 10:52:48 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:48 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9" returned: 0 in 0.499s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:49 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9 Sep 07 10:52:49 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:49 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770" returned: 0 in 0.488s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:49 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770 Sep 07 10:52:49 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:49 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-294fc758-59d1-479b-81de-c8a5e0b0ceb9" returned: 0 in 0.344s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-quobyte-294fc758-59d1-479b-81de-c8a5e0b0ceb9" released by "delete_volume" :: held 0.919s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.quota [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Created reservations ['edfacb60-7ebe-4505-ae07-a6170bbbc6c9', 'e16c7575-e35a-4377-ab1a-f7f56fb15084', '592c50f1-eb40-467a-9d5c-519353b2992e', '25d8732e-a1c8-4b38-bddd-70342f17edbf'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:49 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8fb42ed8-19da-4b83-8fab-ff1850c22770" returned: 0 in 0.394s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:49 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:49 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Lock "cinder-quobyte-8fb42ed8-19da-4b83-8fab-ff1850c22770" released by "delete_volume" :: held 0.946s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.quota [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Created reservations ['38989edd-cd57-4b27-a85c-bdbb452cde92', 'f00a5d48-86f9-4410-a2b9-8a8e8e203e4b', '7c6ce330-7ef5-4ce4-a613-f7cac18ae9c0', '6c0bf532-ca6b-471a-9f2d-633562efce65'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:49 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:49 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:49 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.309s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.manager [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Deleted volume successfully. Sep 07 10:52:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-19f6c1d9-068f-4eb5-89ee-d4e2a2c57f33 req-5d186e65-4729-4fcd-ab7d-74e0e3d6e6c6 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-294fc758-59d1-479b-81de-c8a5e0b0ceb9-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:50 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.291s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG cinder.manager [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Deleted volume successfully. Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-321b9b8f-1f4b-4350-ab84-f862c1b9bed9 req-2a1cb859-448e-4dae-866b-fd7ab6c7def6 tempest-VolumesGetTestJSON-1646915907 None] Lock "cinder-8fb42ed8-19da-4b83-8fab-ff1850c22770-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "cinder-bb45a979-7523-4158-9b46-5b9ccc02c523-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-bb45a979-7523-4158-9b46-5b9ccc02c523-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "cinder-quobyte-bb45a979-7523-4158-9b46-5b9ccc02c523" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-quobyte-bb45a979-7523-4158-9b46-5b9ccc02c523" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[454528f6-98d9-4bcf-b94f-ed247cce2157]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:52:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:51 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 Sep 07 10:52:51 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:51 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523" returned: 0 in 0.425s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:51 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523 Sep 07 10:52:51 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:51 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-bb45a979-7523-4158-9b46-5b9ccc02c523" returned: 0 in 0.279s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-quobyte-bb45a979-7523-4158-9b46-5b9ccc02c523" released by "delete_volume" :: held 0.770s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Created reservations ['e97c1ff7-1f88-4090-8800-e91006796504', '89333ae0-d42a-46b1-bb8e-ad739ae6cb0e', 'a2ca5916-2601-44cc-aae4-ec0d7ea843c1', '42f64a92-2583-406c-ae3b-7f300b54aa8b'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:52:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:52:51 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:52:51 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:52:52 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Sep 07 10:52:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:52:52 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:52:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Deleted volume successfully. Sep 07 10:52:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca217718-b871-4791-9f40-3ae0e65849b5 tempest-ServerActionsTestOtherA-775225044 None] Lock "cinder-bb45a979-7523-4158-9b46-5b9ccc02c523-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1c67cb69-edb9-478a-b0de-47d8ddf5f580 tempest-GroupsTest-1871152515 None] Group tempest-Group1-1749997034: creating Sep 07 10:53:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1c67cb69-edb9-478a-b0de-47d8ddf5f580 tempest-GroupsTest-1871152515 None] Group tempest-Group1-1749997034: created successfully Sep 07 10:53:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1c67cb69-edb9-478a-b0de-47d8ddf5f580 tempest-GroupsTest-1871152515 None] Create group completed successfully. Sep 07 10:53:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eff18d63-8b75-4ec5-994e-1f9f04001df4 tempest-GroupsTest-1871152515 None] Group tempest-Group2-1685218386: creating Sep 07 10:53:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eff18d63-8b75-4ec5-994e-1f9f04001df4 tempest-GroupsTest-1871152515 None] Group tempest-Group2-1685218386: created successfully Sep 07 10:53:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eff18d63-8b75-4ec5-994e-1f9f04001df4 tempest-GroupsTest-1871152515 None] Create group completed successfully. Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Flow 'volume_create_manager' (c2bf0c04-3d8c-4713-8e95-f599d2661b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c13bd9-57d6-4a75-b21e-c31a647a1146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-0a46854b-fd89-4d1b-b651-d8559c6422da req-318a9fef-67c9-4fcc-b13e-ad422350d24c tempest-AttachVolumeTestJSON-390571070 None] Terminate volume connection completed successfully. Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-0a46854b-fd89-4d1b-b651-d8559c6422da req-318a9fef-67c9-4fcc-b13e-ad422350d24c tempest-AttachVolumeTestJSON-390571070 None] Deleting attachment ae5bfe67-d86d-4b9e-a8ad-d02d8a97ebe9. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c13bd9-57d6-4a75-b21e-c31a647a1146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1639257708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b657a7a5-e5f7-4834-bfb2-97e4114f1253,host='devstack@QuobyteHD#QuobyteHD',id=07e426af-65cc-4f88-a262-ec940d2e07b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b714d091e5f742cc8b5f7f39fe354c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:04Z,use_quota=True,user_id='1db520ad1a4c4b4c81d35d3742ce4644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f631919-9d8d-4814-9c7d-c8d54682e5fc),volume_type_id=2f631919-9d8d-4814-9c7d-c8d54682e5fc)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17a3ae5-db90-45a0-8b8a-4b92b748a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17a3ae5-db90-45a0-8b8a-4b92b748a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb1300a-e392-4827-ab07-c8b3783aa413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb1300a-e392-4827-ab07-c8b3783aa413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e426af-65cc-4f88-a262-ec940d2e07b1', 'volume_name': 'volume-07e426af-65cc-4f88-a262-ec940d2e07b1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbed3b00-61ba-45a1-b9aa-f745d645e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbed3b00-61ba-45a1-b9aa-f745d645e57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6eed7e-f823-48fe-bfe4-ea65bf660d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:04 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Volume 07e426af-65cc-4f88-a262-ec940d2e07b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e426af-65cc-4f88-a262-ec940d2e07b1', 'volume_size': 1} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b657a7a5-e5f7-4834-bfb2-97e4114f1253,created_at=2026-09-07T08:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1639257708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b657a7a5-e5f7-4834-bfb2-97e4114f1253,host='devstack@QuobyteHD#QuobyteHD',id=07e426af-65cc-4f88-a262-ec940d2e07b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b714d091e5f742cc8b5f7f39fe354c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:04Z,use_quota=True,user_id='1db520ad1a4c4b4c81d35d3742ce4644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f631919-9d8d-4814-9c7d-c8d54682e5fc),volume_type_id=2f631919-9d8d-4814-9c7d-c8d54682e5fc)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Creating volume 07e426af-65cc-4f88-a262-ec940d2e07b1 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:04 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:04 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 1073741824 Sep 07 10:53:04 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:05 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 1073741824" returned: 0 in 0.699s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:05 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 Sep 07 10:53:05 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:05 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1" returned: 0 in 0.369s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6eed7e-f823-48fe-bfe4-ea65bf660d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e426af-65cc-4f88-a262-ec940d2e07b1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc3e34-3cf9-4887-9878-6a39b5529cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Volume volume-07e426af-65cc-4f88-a262-ec940d2e07b1 (07e426af-65cc-4f88-a262-ec940d2e07b1): created successfully Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc3e34-3cf9-4887-9878-6a39b5529cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Flow 'volume_create_manager' (c2bf0c04-3d8c-4713-8e95-f599d2661b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ce07ecb7-9a72-499b-b58c-7b1471ea426f tempest-GroupsTest-1871152515 None] Created volume successfully. Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=80,cinder:UPDATE=94,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Flow 'volume_create_manager' (c33dd704-f89e-4b97-ab22-059da5cbdc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76838c41-1b2d-48a0-a453-c89945c404b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=82,cinder:SELECT=69,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76838c41-1b2d-48a0-a453-c89945c404b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1530879076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232e470a-ac80-45f8-bcbd-d739725a481d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301e306101f24d5892aa47f1b9b4d8e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:06Z,use_quota=True,user_id='90cda25b848240d08befce2385d5d568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d19113-c9c1-430f-b847-dcce3756efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d19113-c9c1-430f-b847-dcce3756efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d54a8c7-3746-4801-bd9c-6cb7da48171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d54a8c7-3746-4801-bd9c-6cb7da48171b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232e470a-ac80-45f8-bcbd-d739725a481d', 'volume_name': 'volume-232e470a-ac80-45f8-bcbd-d739725a481d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f9daac-4e7b-408e-abac-c797b01b9633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f9daac-4e7b-408e-abac-c797b01b9633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd06b8b-87d2-487f-a834-01c052820147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Volume 232e470a-ac80-45f8-bcbd-d739725a481d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232e470a-ac80-45f8-bcbd-d739725a481d', 'volume_size': 1} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1530879076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232e470a-ac80-45f8-bcbd-d739725a481d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301e306101f24d5892aa47f1b9b4d8e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:06Z,use_quota=True,user_id='90cda25b848240d08befce2385d5d568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Creating volume 232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:05 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:05 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d 1073741824 Sep 07 10:53:05 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:06 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d 1073741824" returned: 0 in 0.432s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:06 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d Sep 07 10:53:06 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:06 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d" returned: 0 in 0.308s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd06b8b-87d2-487f-a834-01c052820147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232e470a-ac80-45f8-bcbd-d739725a481d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9a0be5-59ef-4c29-a0ea-398ab6308503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:06 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Volume volume-232e470a-ac80-45f8-bcbd-d739725a481d (232e470a-ac80-45f8-bcbd-d739725a481d): created successfully Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9a0be5-59ef-4c29-a0ea-398ab6308503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Flow 'volume_create_manager' (c33dd704-f89e-4b97-ab22-059da5cbdc43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:06 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-f7dbd324-2dc2-4868-a2a9-3734c07df785 req-2a9c357c-dfc6-4748-a129-5f9f14b62e8d tempest-VolumesSnapshotsTestJSON-1763420218 None] Created volume successfully. Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Creating offline snapshot 826c2760-7dce-4e93-b818-2ec9c211ffff of volume 232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a47b4b-4ca0-44ec-9202-ccbe1c486f64]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:07 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d Sep 07 10:53:07 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Acquiring lock "cinder-quobyte-07e426af-65cc-4f88-a262-ec940d2e07b1" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Lock "cinder-quobyte-07e426af-65cc-4f88-a262-ec940d2e07b1" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b05b2ed-1021-43b9-823b-78aa881fad9c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:08 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d" returned: 0 in 0.653s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:08 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 Sep 07 10:53:08 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:08 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff 1G Sep 07 10:53:08 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:08 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1" returned: 0 in 0.551s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:08 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1 Sep 07 10:53:08 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:08 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff 1G" returned: 0 in 0.745s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232e470a-ac80-45f8-bcbd-d739725a481d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:08 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232e470a-ac80-45f8-bcbd-d739725a481d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff Sep 07 10:53:08 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:08 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07e426af-65cc-4f88-a262-ec940d2e07b1" returned: 0 in 0.515s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Lock "cinder-quobyte-07e426af-65cc-4f88-a262-ec940d2e07b1" released by "delete_volume" :: held 1.170s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Created reservations ['1368317b-3bf2-42a7-9983-bbeab2c743e0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:09 devstack cinder-volume[87271]: WARNING cinder.quota [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1400451981 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1400451981, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:53:09 devstack cinder-volume[87271]: WARNING cinder.quota [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1400451981 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1400451981, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Created reservations ['4ae12702-c73f-463b-ab8b-245db3aaec39', '67148550-b8cd-4406-85ce-80cbee2cf163', '9c86cc01-f78d-4bf1-865d-05b41499d240', '04761ee9-8ba0-4622-8369-059a38355a96'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:09 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:09 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:09 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232e470a-ac80-45f8-bcbd-d739725a481d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff" returned: 0 in 0.625s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:09 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff is being set with open permissions: ugo+rw Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:09 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff Sep 07 10:53:09 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:09 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.368s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:09 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8761e8d2-8187-496b-83dc-587b1ac79ccd tempest-GroupsTest-1871152515 None] Delete group completed successfully. Sep 07 10:53:09 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff" returned: 0 in 0.329s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:09 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.info Sep 07 10:53:09 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:10 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.info" returned: 0 in 0.424s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:10 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.info is being set with open permissions: ugo+rw Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:10 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.info Sep 07 10:53:10 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:10 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:10 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:10 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.info" returned: 0 in 0.544s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Created reservations ['aaa3b922-7d0a-4d10-ba65-954c5394d974'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-7b565afe-f4ef-4861-be2b-64e1964ea9cb req-abf0537c-7266-4fb1-a37b-14dd2e979f57 tempest-VolumesSnapshotsTestJSON-1763420218 None] Create snapshot completed successfully Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:10 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:10 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:11 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.580s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 28 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:53:11 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.429s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-79eca443-e159-4c59-a7a0-0d8e69f48c75 tempest-GroupsTest-1871152515 None] Delete group completed successfully. Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "cinder-826c2760-7dce-4e93-b818-2ec9c211ffff-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-826c2760-7dce-4e93-b818-2ec9c211ffff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "cinder-quobyte-232e470a-ac80-45f8-bcbd-d739725a481d" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-quobyte-232e470a-ac80-45f8-bcbd-d739725a481d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "cinder-quobyte-826c2760-7dce-4e93-b818-2ec9c211ffff" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-quobyte-826c2760-7dce-4e93-b818-2ec9c211ffff" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Deleting offline snapshot 826c2760-7dce-4e93-b818-2ec9c211ffff of volume 232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:53:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] snapshot_file for this snap is: volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:53:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a890e33-df48-4609-8a0e-d7d5fccb636d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:12 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff Sep 07 10:53:12 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:12 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff" returned: 0 in 0.490s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-232e470a-ac80-45f8-bcbd-d739725a481d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:53:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5282bea-a481-433d-bc14-18b0b7cc7015]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e82531e0-6716-4b90-b90e-c060d5e3cf4d tempest-GroupsTest-1871152515 None] Group tempest-GroupsTest-Group-228782532: creating Sep 07 10:53:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e82531e0-6716-4b90-b90e-c060d5e3cf4d tempest-GroupsTest-1871152515 None] Group tempest-GroupsTest-Group-228782532: created successfully Sep 07 10:53:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e82531e0-6716-4b90-b90e-c060d5e3cf4d tempest-GroupsTest-1871152515 None] Create group completed successfully. Sep 07 10:53:12 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d Sep 07 10:53:12 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:13 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d" returned: 0 in 0.565s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:13 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff Sep 07 10:53:13 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:13 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff" returned: 0 in 0.542s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:13 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff Sep 07 10:53:13 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:14 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d.826c2760-7dce-4e93-b818-2ec9c211ffff" returned: 0 in 0.500s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-quobyte-826c2760-7dce-4e93-b818-2ec9c211ffff" released by "_delete_snapshot" :: held 2.426s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-quobyte-232e470a-ac80-45f8-bcbd-d739725a481d" released by "delete_snapshot" :: held 2.500s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:14 devstack cinder-volume[87271]: WARNING cinder.quota [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.quota [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Created reservations ['71189378-794b-4725-b182-a480b78fa160', 'cb6ff9e2-ac11-48cd-a32c-244e219c2c6a', '1b16fb21-2749-443a-b398-9de431fad048', '7024ea3e-ac90-400f-8575-2d8bbe69769a'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Delete snapshot completed successfully. Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-187ecb43-1cd1-4694-82f1-eec824e9883e req-6650e24f-2e7f-4b8c-9d0e-a242f0f5a125 tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-826c2760-7dce-4e93-b818-2ec9c211ffff-delete_snapshot" released by "delete_snapshot" :: held 2.891s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Flow 'volume_create_manager' (57d160cb-97e9-4809-bd86-a88093a4468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de90ad20-243a-437b-8d3e-5849d7d37680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de90ad20-243a-437b-8d3e-5849d7d37680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808828719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=203fd2b9-5ebd-4539-978c-b6cee421add6,host='devstack@QuobyteHD#QuobyteHD',id=fd327471-0adf-418f-8435-84fc9955dfc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b714d091e5f742cc8b5f7f39fe354c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:15Z,use_quota=True,user_id='1db520ad1a4c4b4c81d35d3742ce4644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cca83040-bf5a-4f1e-a69e-2dfc86dabd1c),volume_type_id=cca83040-bf5a-4f1e-a69e-2dfc86dabd1c)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31ae03c-d548-49df-b790-771da19ae3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31ae03c-d548-49df-b790-771da19ae3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dc4aed-c358-405a-94b0-461e5a6d4d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dc4aed-c358-405a-94b0-461e5a6d4d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd327471-0adf-418f-8435-84fc9955dfc7', 'volume_name': 'volume-fd327471-0adf-418f-8435-84fc9955dfc7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd5a331-3e7f-4ef7-9e95-9c8f6e30f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd5a331-3e7f-4ef7-9e95-9c8f6e30f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dff8762-194d-4720-854e-8bdadb5be87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:14 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Volume fd327471-0adf-418f-8435-84fc9955dfc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd327471-0adf-418f-8435-84fc9955dfc7', 'volume_size': 1} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=203fd2b9-5ebd-4539-978c-b6cee421add6,created_at=2026-09-07T08:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808828719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=203fd2b9-5ebd-4539-978c-b6cee421add6,host='devstack@QuobyteHD#QuobyteHD',id=fd327471-0adf-418f-8435-84fc9955dfc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b714d091e5f742cc8b5f7f39fe354c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:15Z,use_quota=True,user_id='1db520ad1a4c4b4c81d35d3742ce4644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cca83040-bf5a-4f1e-a69e-2dfc86dabd1c),volume_type_id=cca83040-bf5a-4f1e-a69e-2dfc86dabd1c)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Creating volume fd327471-0adf-418f-8435-84fc9955dfc7 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:14 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:14 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 1073741824 Sep 07 10:53:14 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "cinder-232e470a-ac80-45f8-bcbd-d739725a481d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-232e470a-ac80-45f8-bcbd-d739725a481d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "cinder-quobyte-232e470a-ac80-45f8-bcbd-d739725a481d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-quobyte-232e470a-ac80-45f8-bcbd-d739725a481d" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8caf5-6778-4e9d-bbda-374b828775be]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:15 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d Sep 07 10:53:15 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:15 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 1073741824" returned: 0 in 0.677s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:15 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 Sep 07 10:53:15 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:15 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d" returned: 0 in 0.495s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:15 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d Sep 07 10:53:15 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:15 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7" returned: 0 in 0.303s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dff8762-194d-4720-854e-8bdadb5be87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd327471-0adf-418f-8435-84fc9955dfc7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0a6b70-435d-470f-b20f-95558d755748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:16 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Volume volume-fd327471-0adf-418f-8435-84fc9955dfc7 (fd327471-0adf-418f-8435-84fc9955dfc7): created successfully Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0a6b70-435d-470f-b20f-95558d755748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Flow 'volume_create_manager' (57d160cb-97e9-4809-bd86-a88093a4468b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bebbe673-660f-4a7b-9019-39cabd35b6f6 tempest-GroupsTest-1871152515 None] Created volume successfully. Sep 07 10:53:16 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-232e470a-ac80-45f8-bcbd-d739725a481d" returned: 0 in 0.345s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-quobyte-232e470a-ac80-45f8-bcbd-d739725a481d" released by "delete_volume" :: held 0.926s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.quota [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Created reservations ['7312d43e-43a2-402e-84cd-962b9927be59', '39f66076-343e-4647-b610-4464281713d0', '39cd156d-0908-458e-aab8-6ecc8b24dd83', '6591fb39-7dc7-49d3-9973-8bab0f2bf67b'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:16 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:16 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:16 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.412s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.manager [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Deleted volume successfully. Sep 07 10:53:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-14edc1a4-08da-4cdd-bd4a-160103cba62e req-d4ded973-6be3-4a9e-b9dd-cfdbe0982a4c tempest-VolumesSnapshotsTestJSON-1763420218 None] Lock "cinder-232e470a-ac80-45f8-bcbd-d739725a481d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Flow 'volume_create_manager' (4a6cd3a1-dc44-4f57-b0b3-94624a116eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b713b65a-d028-44e5-a478-aa579a35ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b713b65a-d028-44e5-a478-aa579a35ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1429168428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=203fd2b9-5ebd-4539-978c-b6cee421add6,host='devstack@QuobyteHD#QuobyteHD',id=dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b714d091e5f742cc8b5f7f39fe354c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:18Z,use_quota=True,user_id='1db520ad1a4c4b4c81d35d3742ce4644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cca83040-bf5a-4f1e-a69e-2dfc86dabd1c),volume_type_id=cca83040-bf5a-4f1e-a69e-2dfc86dabd1c)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84679e4e-e812-4e4a-9e44-c22b1df51497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84679e4e-e812-4e4a-9e44-c22b1df51497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0279ae6f-8d3c-4c6c-973f-bdf7591df672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0279ae6f-8d3c-4c6c-973f-bdf7591df672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc', 'volume_name': 'volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4b2be7-7c9e-4cfa-81ac-811c1cdb6d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4b2be7-7c9e-4cfa-81ac-811c1cdb6d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab71980c-0f7a-46df-a930-a66e63716af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:18 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Volume dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc', 'volume_size': 1} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=203fd2b9-5ebd-4539-978c-b6cee421add6,created_at=2026-09-07T08:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1429168428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=203fd2b9-5ebd-4539-978c-b6cee421add6,host='devstack@QuobyteHD#QuobyteHD',id=dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b714d091e5f742cc8b5f7f39fe354c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:18Z,use_quota=True,user_id='1db520ad1a4c4b4c81d35d3742ce4644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cca83040-bf5a-4f1e-a69e-2dfc86dabd1c),volume_type_id=cca83040-bf5a-4f1e-a69e-2dfc86dabd1c)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Creating volume dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:18 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:18 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc 1073741824 Sep 07 10:53:18 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:19 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Flow 'volume_create_manager' (c21c215b-33b0-4e15-aea3-193a20e88354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b1cfc-1af5-4ac0-9733-339ef36588a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc 1073741824" returned: 0 in 0.794s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b1cfc-1af5-4ac0-9733-339ef36588a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1174423332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54e6dc9-36d8-4131-ae08-f5329e2e2c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57814a1258f0406e9e538ab728870ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:19Z,use_quota=True,user_id='05b7a5528a6541619aaa779144d7afd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db9672d-6a28-4dbb-9126-4c866dc142a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db9672d-6a28-4dbb-9126-4c866dc142a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52581d4-e081-4303-907f-6f6bf1092ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52581d4-e081-4303-907f-6f6bf1092ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54e6dc9-36d8-4131-ae08-f5329e2e2c19', 'volume_name': 'volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e78573-7eb4-4d52-9457-12f2bcab0a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e78573-7eb4-4d52-9457-12f2bcab0a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4832076-cad5-4289-a42f-8732c2fe5be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Volume c54e6dc9-36d8-4131-ae08-f5329e2e2c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19', 'volume_size': 1} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:19 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc Sep 07 10:53:19 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:19 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc" returned: 0 in 0.293s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1174423332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54e6dc9-36d8-4131-ae08-f5329e2e2c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57814a1258f0406e9e538ab728870ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:19Z,use_quota=True,user_id='05b7a5528a6541619aaa779144d7afd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Creating volume c54e6dc9-36d8-4131-ae08-f5329e2e2c19 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:19 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab71980c-0f7a-46df-a930-a66e63716af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:19 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 1073741824 Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2992588d-0834-497f-b337-3269bdfa87ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:19 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Volume volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc (dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc): created successfully Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2992588d-0834-497f-b337-3269bdfa87ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Flow 'volume_create_manager' (4a6cd3a1-dc44-4f57-b0b3-94624a116eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fa9b7c6b-1974-495f-86e4-b98439035511 tempest-GroupsTest-1871152515 None] Created volume successfully. Sep 07 10:53:20 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 1073741824" returned: 0 in 0.538s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:20 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 Sep 07 10:53:20 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:20 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19" returned: 0 in 0.294s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4832076-cad5-4289-a42f-8732c2fe5be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3c238f-1a8e-4432-8f46-285da24580df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:20 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Volume volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 (c54e6dc9-36d8-4131-ae08-f5329e2e2c19): created successfully Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3c238f-1a8e-4432-8f46-285da24580df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Flow 'volume_create_manager' (c21c215b-33b0-4e15-aea3-193a20e88354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-654a5acf-7123-46f8-b0ba-50dcc884a152 tempest-VolumesServicesTestJSON-667690926 None] Created volume successfully. Sep 07 10:53:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-128eaee3-2568-496f-b9b1-5129fe283a92 tempest-GroupsTest-1871152515 None] Update group completed successfully. Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Acquiring lock "cinder-c54e6dc9-36d8-4131-ae08-f5329e2e2c19-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Lock "cinder-c54e6dc9-36d8-4131-ae08-f5329e2e2c19-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Acquiring lock "cinder-quobyte-c54e6dc9-36d8-4131-ae08-f5329e2e2c19" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Lock "cinder-quobyte-c54e6dc9-36d8-4131-ae08-f5329e2e2c19" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a5368a-18db-4ae9-b68f-df7cebae8d67]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:21 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 Sep 07 10:53:21 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Flow 'volume_create_manager' (0d535f21-e051-415a-98d1-b6dc920ff163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae489166-3620-436d-a5d9-30dc10a1584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae489166-3620-436d-a5d9-30dc10a1584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1699718758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889e7f53-88db-48cc-80b2-81b07ceeef57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3797a7696a4c6eb6a2b5d7a17d1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:22Z,use_quota=True,user_id='546b05ec32c74099803afa1faf04ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbead27-ae7a-4f86-9186-0c4215b3f2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbead27-ae7a-4f86-9186-0c4215b3f2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cc5071-befa-49e6-8a1a-1c475e0413ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cc5071-befa-49e6-8a1a-1c475e0413ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889e7f53-88db-48cc-80b2-81b07ceeef57', 'volume_name': 'volume-889e7f53-88db-48cc-80b2-81b07ceeef57', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0108bf78-b5ad-4f0b-9da9-ac43ab196c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0108bf78-b5ad-4f0b-9da9-ac43ab196c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b74466-c882-4226-9dfe-a2f79bb01d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Volume 889e7f53-88db-48cc-80b2-81b07ceeef57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889e7f53-88db-48cc-80b2-81b07ceeef57', 'volume_size': 1} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1699718758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889e7f53-88db-48cc-80b2-81b07ceeef57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3797a7696a4c6eb6a2b5d7a17d1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:22Z,use_quota=True,user_id='546b05ec32c74099803afa1faf04ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Creating volume 889e7f53-88db-48cc-80b2-81b07ceeef57 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:21 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:21 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 1073741824 Sep 07 10:53:21 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:21 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19" returned: 0 in 0.435s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:21 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19 Sep 07 10:53:21 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:22 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c54e6dc9-36d8-4131-ae08-f5329e2e2c19" returned: 0 in 0.351s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Lock "cinder-quobyte-c54e6dc9-36d8-4131-ae08-f5329e2e2c19" released by "delete_volume" :: held 0.836s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Created reservations ['6a826bd5-1119-4820-813a-16bd167e7b7f', '1403b1d0-693e-46a2-a0de-0d0eefab1584', '5dd8dd1c-19ef-464d-8702-4563e81d57cc', '8f2f263d-60eb-47fc-8808-ca8e114ca8c6'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:22 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 1073741824" returned: 0 in 0.637s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2dcf892d-6419-492c-be15-b6d4ebae8513 tempest-GroupsTest-1871152515 None] Update group completed successfully. Sep 07 10:53:22 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:22 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:22 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 Sep 07 10:53:22 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:22 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57" returned: 0 in 0.298s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b74466-c882-4226-9dfe-a2f79bb01d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889e7f53-88db-48cc-80b2-81b07ceeef57', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:22 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e583f225-a791-4707-a4e8-60ee602317dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.368s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Deleted volume successfully. Sep 07 10:53:22 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Volume volume-889e7f53-88db-48cc-80b2-81b07ceeef57 (889e7f53-88db-48cc-80b2-81b07ceeef57): created successfully Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e583f225-a791-4707-a4e8-60ee602317dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Flow 'volume_create_manager' (0d535f21-e051-415a-98d1-b6dc920ff163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bf4e5c36-eb82-4e1e-88e8-f2537c23d8ce tempest-VolumesTestJSON-1003667991 None] Created volume successfully. Sep 07 10:53:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6cdf2f8-5c97-4819-a84e-da598515eeaf tempest-VolumesServicesTestJSON-667690926 None] Lock "cinder-c54e6dc9-36d8-4131-ae08-f5329e2e2c19-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Acquiring lock "cinder-quobyte-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Lock "cinder-quobyte-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc" acquired by "delete_volume" :: waited 0.051s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[047fc2cb-e1e0-49d9-8afa-eec9261ef945]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:24 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc Sep 07 10:53:24 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Flow 'volume_create_manager' (57a1508f-2744-4dda-bd50-b4815a02f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d95543-6bc8-40a2-902b-b9087c0ddb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d95543-6bc8-40a2-902b-b9087c0ddb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1591685570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7f61b5-a188-442b-af6a-a66aecd3c0e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3797a7696a4c6eb6a2b5d7a17d1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:24Z,use_quota=True,user_id='546b05ec32c74099803afa1faf04ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aacf2d-e23b-401f-be97-32dc56d636a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aacf2d-e23b-401f-be97-32dc56d636a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2864ebda-0df2-4755-b7f0-e2445dbeb369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2864ebda-0df2-4755-b7f0-e2445dbeb369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7f61b5-a188-442b-af6a-a66aecd3c0e6', 'volume_name': 'volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a845c755-7091-4cb6-8e3a-112d824adbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a845c755-7091-4cb6-8e3a-112d824adbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b37716-5e27-4d5d-9115-bba17dd4f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Volume cc7f61b5-a188-442b-af6a-a66aecd3c0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6', 'volume_size': 1} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1591685570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7f61b5-a188-442b-af6a-a66aecd3c0e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3797a7696a4c6eb6a2b5d7a17d1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:24Z,use_quota=True,user_id='546b05ec32c74099803afa1faf04ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Creating volume cc7f61b5-a188-442b-af6a-a66aecd3c0e6 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:24 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 1073741824 Sep 07 10:53:24 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:24 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc" returned: 0 in 0.486s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:24 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc Sep 07 10:53:24 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:25 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 1073741824" returned: 0 in 0.553s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:25 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc" returned: 0 in 0.318s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Lock "cinder-quobyte-dfaa3fe5-2cdf-44f3-afb5-9c6033b3d8cc" released by "delete_volume" :: held 0.871s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Acquiring lock "cinder-quobyte-fd327471-0adf-418f-8435-84fc9955dfc7" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Lock "cinder-quobyte-fd327471-0adf-418f-8435-84fc9955dfc7" acquired by "delete_volume" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:25 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 Sep 07 10:53:25 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdc6908-f661-48d7-be3b-b5c7fd7941fb]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:25 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 Sep 07 10:53:25 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:25 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6" returned: 0 in 0.316s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b37716-5e27-4d5d-9115-bba17dd4f656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f757c88-9100-49d9-90d6-2ace34038996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Volume volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 (cc7f61b5-a188-442b-af6a-a66aecd3c0e6): created successfully Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f757c88-9100-49d9-90d6-2ace34038996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Flow 'volume_create_manager' (57a1508f-2744-4dda-bd50-b4815a02f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-29cad5c4-efa4-4643-bfc9-fdc1314714b5 tempest-VolumesTestJSON-1003667991 None] Created volume successfully. Sep 07 10:53:25 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7" returned: 0 in 0.476s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:25 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7 Sep 07 10:53:25 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:26 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd327471-0adf-418f-8435-84fc9955dfc7" returned: 0 in 0.276s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Lock "cinder-quobyte-fd327471-0adf-418f-8435-84fc9955dfc7" released by "delete_volume" :: held 0.809s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Created reservations ['14bba47d-4312-41fd-b7a8-49826cbd9d92'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:26 devstack cinder-volume[87271]: WARNING cinder.quota [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-938110441 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-938110441, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:53:26 devstack cinder-volume[87271]: WARNING cinder.quota [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-938110441 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-938110441, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Created reservations ['ebe61e99-d183-48d6-bd7e-d6ca072a624b', '048fd668-2e28-49b6-bd5c-3064aa4dac65', '9d91f81a-ba5b-4e72-9f06-d228e03b2989', '1968875f-edaa-4c44-a419-9aa5be719639'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Created reservations ['df92743c-aa1c-4c85-84ab-e87ad5341559', '85e05218-a7ae-4279-8a5b-31c0729d49ee', 'c6c7b034-06b4-4a2c-a736-ca3bd115fab2', '4d3273bf-db98-4696-a275-a8fc4c517bd8'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:26 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:26 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:26 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:26 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e0ce1e03-73ae-4a4e-bbde-56079c83797b tempest-GroupsTest-1871152515 None] Delete group completed successfully. Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Flow 'volume_create_manager' (b00f644a-6eaa-4f17-b3a5-c3bb2b2decc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c22a61-89a3-4c33-8bf2-1f8af71b413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c22a61-89a3-4c33-8bf2-1f8af71b413a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2000897039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91be89b4-18d9-4d2d-b2ac-5bb2f74311da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3797a7696a4c6eb6a2b5d7a17d1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:27Z,use_quota=True,user_id='546b05ec32c74099803afa1faf04ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea3dcf0-df0c-46e4-8258-3721f3021c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea3dcf0-df0c-46e4-8258-3721f3021c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d110ad1a-68ef-420e-9888-394646e3f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d110ad1a-68ef-420e-9888-394646e3f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91be89b4-18d9-4d2d-b2ac-5bb2f74311da', 'volume_name': 'volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da14a6b-7c0c-4c27-9da0-a68530955df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da14a6b-7c0c-4c27-9da0-a68530955df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb87d350-e3bc-4ac8-98c4-f9f1e90b7d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:27 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Volume 91be89b4-18d9-4d2d-b2ac-5bb2f74311da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da', 'volume_size': 1} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2000897039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91be89b4-18d9-4d2d-b2ac-5bb2f74311da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3797a7696a4c6eb6a2b5d7a17d1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:27Z,use_quota=True,user_id='546b05ec32c74099803afa1faf04ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Creating volume 91be89b4-18d9-4d2d-b2ac-5bb2f74311da {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:27 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:27 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da 1073741824 Sep 07 10:53:27 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:27 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da 1073741824" returned: 0 in 0.570s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:27 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da Sep 07 10:53:27 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:28 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da" returned: 0 in 0.327s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb87d350-e3bc-4ac8-98c4-f9f1e90b7d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c27fe02-7d3d-4067-81ba-efc18d65fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:28 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Volume volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da (91be89b4-18d9-4d2d-b2ac-5bb2f74311da): created successfully Sep 07 10:53:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c27fe02-7d3d-4067-81ba-efc18d65fafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Flow 'volume_create_manager' (b00f644a-6eaa-4f17-b3a5-c3bb2b2decc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a9e803c9-10d4-46c7-bad2-d75c27867855 tempest-VolumesTestJSON-1003667991 None] Created volume successfully. Sep 07 10:53:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Acquiring lock "cinder-91be89b4-18d9-4d2d-b2ac-5bb2f74311da-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Lock "cinder-91be89b4-18d9-4d2d-b2ac-5bb2f74311da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Acquiring lock "cinder-quobyte-91be89b4-18d9-4d2d-b2ac-5bb2f74311da" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Lock "cinder-quobyte-91be89b4-18d9-4d2d-b2ac-5bb2f74311da" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:30 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6069170-b79a-4ff7-89fa-5da6fabf8a9b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:31 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da Sep 07 10:53:31 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:31 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da" returned: 0 in 0.500s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:31 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da Sep 07 10:53:31 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:31 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-91be89b4-18d9-4d2d-b2ac-5bb2f74311da" returned: 0 in 0.425s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Lock "cinder-quobyte-91be89b4-18d9-4d2d-b2ac-5bb2f74311da" released by "delete_volume" :: held 0.990s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:31 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Created reservations ['60d9f994-13a6-43a0-be51-42d7c4a96b0b', '043834c1-1d6d-439b-96c1-dce4eebe478f', 'c3db7ff2-6a6f-4029-948f-a8ff6e26ed56', '0f63acae-c793-4fc8-a351-573087f70e4d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:32 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:32 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:32 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.238s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Deleted volume successfully. Sep 07 10:53:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f12a3594-c337-4d0d-a81b-a6f62f323e2f tempest-VolumesTestJSON-1003667991 None] Lock "cinder-91be89b4-18d9-4d2d-b2ac-5bb2f74311da-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "cinder-cc7f61b5-a188-442b-af6a-a66aecd3c0e6-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-cc7f61b5-a188-442b-af6a-a66aecd3c0e6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "cinder-quobyte-cc7f61b5-a188-442b-af6a-a66aecd3c0e6" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-quobyte-cc7f61b5-a188-442b-af6a-a66aecd3c0e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7063e-e259-48f0-93b6-0a59554b32a7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:33 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 Sep 07 10:53:33 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:33 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6" returned: 0 in 0.513s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:33 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6 Sep 07 10:53:33 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:34 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cc7f61b5-a188-442b-af6a-a66aecd3c0e6" returned: 0 in 0.613s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-quobyte-cc7f61b5-a188-442b-af6a-a66aecd3c0e6" released by "delete_volume" :: held 1.195s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Created reservations ['99731ea0-eb12-4cc7-970c-5c0998a20110', 'db7c4f0c-5a6b-4ce6-9193-d22bf36e9bb1', 'a98f61ba-9800-4600-b34f-b925865cb6e2', 'c709b592-4f7e-4f56-898a-e725ef33e537'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:34 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:34 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:34 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.345s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Deleted volume successfully. Sep 07 10:53:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-725629cf-964b-4ffb-ad62-0497bede0ab0 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-cc7f61b5-a188-442b-af6a-a66aecd3c0e6-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-16ff1117-787c-48a1-b091-416c72cab570 tempest-GroupsV320Test-662405797 None] Group tempest-GroupsV320Test-Group-1771110943: creating Sep 07 10:53:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-16ff1117-787c-48a1-b091-416c72cab570 tempest-GroupsV320Test-662405797 None] Group tempest-GroupsV320Test-Group-1771110943: created successfully Sep 07 10:53:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-16ff1117-787c-48a1-b091-416c72cab570 tempest-GroupsV320Test-662405797 None] Create group completed successfully. Sep 07 10:53:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "cinder-889e7f53-88db-48cc-80b2-81b07ceeef57-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-889e7f53-88db-48cc-80b2-81b07ceeef57-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "cinder-quobyte-889e7f53-88db-48cc-80b2-81b07ceeef57" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-quobyte-889e7f53-88db-48cc-80b2-81b07ceeef57" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:35 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b7fb6c-a205-484f-a594-6408983f9a8d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:35 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 Sep 07 10:53:35 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:35 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57" returned: 0 in 0.480s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:36 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57 Sep 07 10:53:36 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:36 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-889e7f53-88db-48cc-80b2-81b07ceeef57" returned: 0 in 0.346s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-quobyte-889e7f53-88db-48cc-80b2-81b07ceeef57" released by "delete_volume" :: held 0.915s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Created reservations ['324f1266-516c-460c-9cea-5bd671e624f5', '58e5d33c-7af2-4af9-a493-bde7fd31af28', '8366bdec-cf16-4136-8a7d-c5994109830d', '45a02b7d-6628-4063-848c-8254b5667b73'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:36 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:36 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:36 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Created reservations ['be429051-7787-400d-ba8b-146ecc7101de'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:53:37 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.352s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Deleted volume successfully. Sep 07 10:53:37 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:53:37 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-62101a61-31f2-42ec-9f45-326bebe70c35 tempest-VolumesTestJSON-1003667991 None] Lock "cinder-889e7f53-88db-48cc-80b2-81b07ceeef57-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:53:37 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.286s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:37 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:53:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ee019e0a-3f06-455a-8cb3-9aad784a3cc4 tempest-GroupsV320Test-662405797 None] Delete group completed successfully. Sep 07 10:53:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=78,cinder:UPDATE=106,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:53:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=94,cinder:UPDATE=106,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Flow 'volume_create_manager' (d2ac7d97-4f0a-468b-814e-0419f9e82613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93b236b-8371-4abf-82b9-5f6cc231b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93b236b-8371-4abf-82b9-5f6cc231b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1238330642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f368bc9-fdad-417d-b78a-276816b26364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9204632b378645e1966b03610004d291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:48Z,use_quota=True,user_id='50a3489780de4b9fb9638b624439d103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240550e-8b05-4afa-bf38-96678c425c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240550e-8b05-4afa-bf38-96678c425c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1941575c-2265-4312-9ebc-0776dc4f4101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1941575c-2265-4312-9ebc-0776dc4f4101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f368bc9-fdad-417d-b78a-276816b26364', 'volume_name': 'volume-7f368bc9-fdad-417d-b78a-276816b26364', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6e3f01-04cc-4267-b8f8-292850e21855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6e3f01-04cc-4267-b8f8-292850e21855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482c8694-3ab2-4cf4-b887-2a935c312701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:48 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Volume 7f368bc9-fdad-417d-b78a-276816b26364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f368bc9-fdad-417d-b78a-276816b26364', 'volume_size': 1} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1238330642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f368bc9-fdad-417d-b78a-276816b26364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9204632b378645e1966b03610004d291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:48Z,use_quota=True,user_id='50a3489780de4b9fb9638b624439d103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Creating volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:48 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:48 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 1073741824 Sep 07 10:53:48 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Flow 'volume_create_manager' (6d771f88-8412-4fd4-86c1-656d98fc060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8951b7-b007-4f62-9f72-254c330da90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8951b7-b007-4f62-9f72-254c330da90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-153420701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02dabf2-f434-457c-bb64-b8f5639beb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e743f42cc8340569a483a8aaeabe664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:49Z,use_quota=True,user_id='2b479742fd7e46379bbe6a44771f390b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69e5775-e0eb-4809-8341-380b5d64ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69e5775-e0eb-4809-8341-380b5d64ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a0a045-82b7-4bb5-9e54-4a5fceced325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a0a045-82b7-4bb5-9e54-4a5fceced325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02dabf2-f434-457c-bb64-b8f5639beb4e', 'volume_name': 'volume-f02dabf2-f434-457c-bb64-b8f5639beb4e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065e9353-5ec6-4cf4-8bd8-84657b073dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065e9353-5ec6-4cf4-8bd8-84657b073dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eb7c45-ec5a-4ca9-bba1-794d60da3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:49 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Volume f02dabf2-f434-457c-bb64-b8f5639beb4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02dabf2-f434-457c-bb64-b8f5639beb4e', 'volume_size': 1} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:49 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 1073741824" returned: 0 in 0.720s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:49 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 Sep 07 10:53:49 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:49 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364" returned: 0 in 0.610s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-153420701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02dabf2-f434-457c-bb64-b8f5639beb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e743f42cc8340569a483a8aaeabe664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:49Z,use_quota=True,user_id='2b479742fd7e46379bbe6a44771f390b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Creating volume f02dabf2-f434-457c-bb64-b8f5639beb4e {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:49 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482c8694-3ab2-4cf4-b887-2a935c312701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f368bc9-fdad-417d-b78a-276816b26364', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c6f8e2-506a-4c19-9d5e-b1228bd88b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:49 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e 1073741824 Sep 07 10:53:49 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:49 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Volume volume-7f368bc9-fdad-417d-b78a-276816b26364 (7f368bc9-fdad-417d-b78a-276816b26364): created successfully Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c6f8e2-506a-4c19-9d5e-b1228bd88b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Flow 'volume_create_manager' (d2ac7d97-4f0a-468b-814e-0419f9e82613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8786201f-c37c-4548-b2ed-cff20b6fba23 tempest-SnapshotsActionsTest-210957374 None] Created volume successfully. Sep 07 10:53:50 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e 1073741824" returned: 0 in 0.710s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:50 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e Sep 07 10:53:50 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:51 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e" returned: 0 in 0.478s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.054s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eb7c45-ec5a-4ca9-bba1-794d60da3a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02dabf2-f434-457c-bb64-b8f5639beb4e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a348a90-833e-4e83-99a4-2967f992d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Creating offline snapshot 8719c824-f068-4919-a2c8-363e60e93a4e of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:53:51 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Volume volume-f02dabf2-f434-457c-bb64-b8f5639beb4e (f02dabf2-f434-457c-bb64-b8f5639beb4e): created successfully Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a348a90-833e-4e83-99a4-2967f992d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Flow 'volume_create_manager' (6d771f88-8412-4fd4-86c1-656d98fc060d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b6dc57-7dce-45c2-a189-4742401816ff]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b1ddbf38-dd18-4875-b0d7-7b9bbcb2b6b3 tempest-VolumesListAdminTestJSON-1546322178 None] Created volume successfully. Sep 07 10:53:51 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 Sep 07 10:53:51 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:51 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364" returned: 0 in 0.532s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:51 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e 1G Sep 07 10:53:51 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:52 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e 1G" returned: 0 in 0.570s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:52 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:53:52 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:52 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.565s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:52 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e is being set with open permissions: ugo+rw Sep 07 10:53:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:52 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:53:52 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:52 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Flow 'volume_create_manager' (2361e458-c888-4b47-bae1-4de44cd2a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7226e6d9-e8a1-49b5-9b55-8198112536f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7226e6d9-e8a1-49b5-9b55-8198112536f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-773259152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2003bd5d-ea19-4b0d-9027-15a193fbdd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e743f42cc8340569a483a8aaeabe664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:53Z,use_quota=True,user_id='2b479742fd7e46379bbe6a44771f390b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee81ef1e-9421-496e-966f-5499abea8040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee81ef1e-9421-496e-966f-5499abea8040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d399fbd1-47fc-4ab6-9664-c4cef78f3ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d399fbd1-47fc-4ab6-9664-c4cef78f3ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2003bd5d-ea19-4b0d-9027-15a193fbdd60', 'volume_name': 'volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91a9678-0d06-45f1-a221-badfbd196da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91a9678-0d06-45f1-a221-badfbd196da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977c7604-9e43-4704-95a2-94ed8f96b4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:53 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Volume 2003bd5d-ea19-4b0d-9027-15a193fbdd60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60', 'volume_size': 1} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:53 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.475s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:53 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.info Sep 07 10:53:53 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:53 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.info" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:53 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.info is being set with open permissions: ugo+rw Sep 07 10:53:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:53 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.info Sep 07 10:53:53 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:54 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.info" returned: 0 in 0.334s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-773259152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2003bd5d-ea19-4b0d-9027-15a193fbdd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e743f42cc8340569a483a8aaeabe664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:53Z,use_quota=True,user_id='2b479742fd7e46379bbe6a44771f390b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Creating volume 2003bd5d-ea19-4b0d-9027-15a193fbdd60 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:54 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:54 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 1073741824 Sep 07 10:53:54 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:54 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-3d207aa8-277f-4e85-b3b1-d4bd3dc77090 tempest-SnapshotsActionsTest-210957374 None] Create snapshot completed successfully Sep 07 10:53:54 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 1073741824" returned: 0 in 0.569s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:54 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 Sep 07 10:53:54 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:55 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60" returned: 0 in 0.414s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977c7604-9e43-4704-95a2-94ed8f96b4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13499efc-1b50-4a95-8355-db21e2be3c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:55 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Volume volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 (2003bd5d-ea19-4b0d-9027-15a193fbdd60): created successfully Sep 07 10:53:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13499efc-1b50-4a95-8355-db21e2be3c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Flow 'volume_create_manager' (2361e458-c888-4b47-bae1-4de44cd2a000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9644dcb5-e8e8-449d-a497-30028f158b74 tempest-VolumesListAdminTestJSON-1546322178 None] Created volume successfully. Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Creating offline snapshot 73dbd08b-738e-42e8-b14c-1b2d07b4770a of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b4094-20c2-4b04-96ca-d24bc0120722]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:56 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:53:56 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:56 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.534s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:56 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a 1G Sep 07 10:53:56 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Flow 'volume_create_manager' (75daf76a-fca3-4d1d-a10b-8a24773fc0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d8e8b-beec-49a5-ab68-6ceb7b98ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d8e8b-beec-49a5-ab68-6ceb7b98ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-795029800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01622ea6-e344-4a46-b2e7-7d7ec00c69ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e743f42cc8340569a483a8aaeabe664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:57Z,use_quota=True,user_id='2b479742fd7e46379bbe6a44771f390b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f845789b-a599-4222-a704-35fed2181385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f845789b-a599-4222-a704-35fed2181385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0da05cb-bca1-4e8d-92e2-ef2da701f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0da05cb-bca1-4e8d-92e2-ef2da701f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01622ea6-e344-4a46-b2e7-7d7ec00c69ef', 'volume_name': 'volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4755be0e-f594-44d4-83a3-57e3d0e1a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4755be0e-f594-44d4-83a3-57e3d0e1a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c566e-289b-4ebd-8902-db5f75a99b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:56 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Volume 01622ea6-e344-4a46-b2e7-7d7ec00c69ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef', 'volume_size': 1} Sep 07 10:53:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:57 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a 1G" returned: 0 in 0.497s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:57 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a Sep 07 10:53:57 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:57 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:57 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a is being set with open permissions: ugo+rw Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:57 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a Sep 07 10:53:57 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:57 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a" returned: 0 in 0.299s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-795029800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01622ea6-e344-4a46-b2e7-7d7ec00c69ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e743f42cc8340569a483a8aaeabe664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:57Z,use_quota=True,user_id='2b479742fd7e46379bbe6a44771f390b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Creating volume 01622ea6-e344-4a46-b2e7-7d7ec00c69ef {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:57 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:58 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef 1073741824 Sep 07 10:53:58 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e94829f5-331a-4201-982d-6b38309fd317 tempest-SnapshotsActionsTest-210957374 None] Create snapshot completed successfully Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Flow 'volume_create_manager' (e3c4b9e4-c471-4d3b-9e7c-ccd6befb65d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e407a8e-550a-4bde-ba20-87e7c442326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e407a8e-550a-4bde-ba20-87e7c442326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141829921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8d5ba1-9a0c-4c0f-8088-37f5287b1576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eeffed31284df4a7d9a6d2c2a60fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:58Z,use_quota=True,user_id='87b99d72341d4015880e1c773eee5af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fddc44c-fdb9-411b-a0aa-a0da9e0a8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fddc44c-fdb9-411b-a0aa-a0da9e0a8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0b4bd6-bcde-4c5e-878e-0551ec8c229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0b4bd6-bcde-4c5e-878e-0551ec8c229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8d5ba1-9a0c-4c0f-8088-37f5287b1576', 'volume_name': 'volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6916018d-36a2-4b08-9b82-7b06da0e28d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6916018d-36a2-4b08-9b82-7b06da0e28d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812f397a-32e1-4519-bb57-773c5791e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:58 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Volume ae8d5ba1-9a0c-4c0f-8088-37f5287b1576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576', 'volume_size': 1} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-73dbd08b-738e-42e8-b14c-1b2d07b4770a-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-73dbd08b-738e-42e8-b14c-1b2d07b4770a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-73dbd08b-738e-42e8-b14c-1b2d07b4770a" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-73dbd08b-738e-42e8-b14c-1b2d07b4770a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Deleting offline snapshot 73dbd08b-738e-42e8-b14c-1b2d07b4770a of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] snapshot_file for this snap is: volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[507ad051-594e-4015-b94f-8452546323a3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:58 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef 1073741824" returned: 0 in 0.610s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:58 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef Sep 07 10:53:58 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:58 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a Sep 07 10:53:58 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:58 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef" returned: 0 in 0.260s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141829921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8d5ba1-9a0c-4c0f-8088-37f5287b1576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eeffed31284df4a7d9a6d2c2a60fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:53:58Z,use_quota=True,user_id='87b99d72341d4015880e1c773eee5af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Creating volume ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:53:58 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c566e-289b-4ebd-8902-db5f75a99b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffebde0-223d-4b7c-8639-e53942e82316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:58 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 1073741824 Sep 07 10:53:58 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:58 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Volume volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef (01622ea6-e344-4a46-b2e7-7d7ec00c69ef): created successfully Sep 07 10:53:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffebde0-223d-4b7c-8639-e53942e82316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Flow 'volume_create_manager' (75daf76a-fca3-4d1d-a10b-8a24773fc0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c559b6d8-1449-431d-b3cf-0c013c806ddf tempest-VolumesListAdminTestJSON-1546322178 None] Created volume successfully. Sep 07 10:53:59 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a" returned: 0 in 0.490s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcdb135-a2a3-4c43-aa79-31181d093728]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:59 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:53:59 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:59 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 1073741824" returned: 0 in 0.531s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:59 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 Sep 07 10:53:59 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:59 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.465s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:53:59 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a Sep 07 10:53:59 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:53:59 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576" returned: 0 in 0.260s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812f397a-32e1-4519-bb57-773c5791e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ac43cd-58d7-4133-a26e-ecd026c98975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:53:59 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Volume volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 (ae8d5ba1-9a0c-4c0f-8088-37f5287b1576): created successfully Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ac43cd-58d7-4133-a26e-ecd026c98975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:53:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Flow 'volume_create_manager' (e3c4b9e4-c471-4d3b-9e7c-ccd6befb65d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:53:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1aac3b3b-8fb5-497c-b4e8-720c01122f11 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Created volume successfully. Sep 07 10:54:00 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a" returned: 0 in 0.419s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:00 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a Sep 07 10:54:00 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:00 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.73dbd08b-738e-42e8-b14c-1b2d07b4770a" returned: 0 in 0.308s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-73dbd08b-738e-42e8-b14c-1b2d07b4770a" released by "_delete_snapshot" :: held 1.828s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" released by "delete_snapshot" :: held 1.872s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Acquiring lock "cinder-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "cinder-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Acquiring lock "cinder-quobyte-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Created reservations ['7cd775e7-5e36-46d7-a44f-19e5fa3ed314', '089074e3-7e16-47d9-a292-449287bd19f0', '81bc948a-afcd-404d-acdc-d59b2f386df6', 'a6e8eab6-82ab-4ce5-8c68-b2f6ff72abba'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "cinder-quobyte-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576" acquired by "delete_volume" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b8f3e-6745-4c96-b57a-d2741bd77a8c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Delete snapshot completed successfully. Sep 07 10:54:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b7e79ab5-31ca-4ed1-97a5-3de4ef62e33e tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-73dbd08b-738e-42e8-b14c-1b2d07b4770a-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:00 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 Sep 07 10:54:00 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:01 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576" returned: 0 in 0.527s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:01 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576 Sep 07 10:54:01 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Flow 'volume_create_manager' (fa6911d3-03b7-45d1-8102-453be11048f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320ffe88-1eba-4f4e-ac90-161292897be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Creating offline snapshot b0c69bba-61ff-4146-ba57-473fc7b066bb of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320ffe88-1eba-4f4e-ac90-161292897be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1074a345-633a-4a30-8be3-a0500b0ef3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c753b96ffa64971a0d9e9c56f74ca61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:01Z,use_quota=True,user_id='e917bf991d4541978aed6bd0bb959fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b776ab-3b19-4e36-b49a-bbd4f0a53b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b776ab-3b19-4e36-b49a-bbd4f0a53b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78204990-9450-4116-9ebc-a03152f8a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78204990-9450-4116-9ebc-a03152f8a650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1074a345-633a-4a30-8be3-a0500b0ef3ac', 'volume_name': 'volume-1074a345-633a-4a30-8be3-a0500b0ef3ac', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2165cf25-fbb2-4f30-8cbc-c36c5e82fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2165cf25-fbb2-4f30-8cbc-c36c5e82fd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c05897d-5c25-4b2e-a68f-63be0cb83585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Volume 1074a345-633a-4a30-8be3-a0500b0ef3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1074a345-633a-4a30-8be3-a0500b0ef3ac', 'volume_size': 1} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c3df4-dfa9-49fa-b4c6-cdb5cd8dc182]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:01 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576" returned: 0 in 0.310s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "cinder-quobyte-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576" released by "delete_volume" :: held 0.894s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Created reservations ['eeae16f2-6c7c-476e-bdec-f0afc9b5927b', 'a06bc0c3-f298-4686-8d50-5d881f7dc9d9', 'abd5cfdc-c386-41ff-8216-a84133249d8d', 'abd3f8fb-f514-4d48-a71e-51e9cfe8346d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:01 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:01 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:01 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:01 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:01 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.437s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:01 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb 1G Sep 07 10:54:01 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:01 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.362s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Deleted volume successfully. Sep 07 10:54:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86faf42c-ac7c-43c9-bee4-87a04206c4c0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "cinder-ae8d5ba1-9a0c-4c0f-8088-37f5287b1576-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Flow 'volume_create_manager' (e134262d-9ffc-4614-937d-e661769b9d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc85ccb-48e7-422f-8a7c-5971e8abbf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc85ccb-48e7-422f-8a7c-5971e8abbf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1106196040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3bb73e-9501-404e-8507-402025a2fc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eeffed31284df4a7d9a6d2c2a60fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:02Z,use_quota=True,user_id='87b99d72341d4015880e1c773eee5af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:02 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6864e3-de8a-4755-9e9d-569fcea35779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6864e3-de8a-4755-9e9d-569fcea35779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a01cc9-d391-46c4-b4bb-bf4e70f9f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a01cc9-d391-46c4-b4bb-bf4e70f9f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3bb73e-9501-404e-8507-402025a2fc3a', 'volume_name': 'volume-ba3bb73e-9501-404e-8507-402025a2fc3a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989c45ad-2c77-428d-83c0-f9b67baf9dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989c45ad-2c77-428d-83c0-f9b67baf9dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef8e2ef-f501-46ee-8c12-7504458d270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Volume ba3bb73e-9501-404e-8507-402025a2fc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3bb73e-9501-404e-8507-402025a2fc3a', 'volume_size': 1} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb 1G" returned: 0 in 0.601s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:02 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb Sep 07 10:54:02 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:02 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb" returned: 0 in 0.287s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:02 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb is being set with open permissions: ugo+rw Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:02 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb Sep 07 10:54:02 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:02 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.721s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1074a345-633a-4a30-8be3-a0500b0ef3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c753b96ffa64971a0d9e9c56f74ca61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:01Z,use_quota=True,user_id='e917bf991d4541978aed6bd0bb959fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Creating volume 1074a345-633a-4a30-8be3-a0500b0ef3ac {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:03 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:03 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac 1073741824 Sep 07 10:54:03 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6311f2f7-84c2-4a2d-9245-992e9af3bb80 tempest-SnapshotsActionsTest-210957374 None] Create snapshot completed successfully Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-b0c69bba-61ff-4146-ba57-473fc7b066bb-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-b0c69bba-61ff-4146-ba57-473fc7b066bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-b0c69bba-61ff-4146-ba57-473fc7b066bb" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-b0c69bba-61ff-4146-ba57-473fc7b066bb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Deleting offline snapshot b0c69bba-61ff-4146-ba57-473fc7b066bb of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] snapshot_file for this snap is: volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5398c59d-c437-4e34-8576-63a4d10e6467]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:03 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac 1073741824" returned: 0 in 0.515s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:03 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb Sep 07 10:54:03 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:03 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac Sep 07 10:54:03 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:03 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb" returned: 0 in 0.458s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:03 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac" returned: 0 in 0.276s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1106196040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3bb73e-9501-404e-8507-402025a2fc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eeffed31284df4a7d9a6d2c2a60fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:02Z,use_quota=True,user_id='87b99d72341d4015880e1c773eee5af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Creating volume ba3bb73e-9501-404e-8507-402025a2fc3a {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:03 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab8e178-6a17-43fd-9f84-d5fa1e520264]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:03 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a 1073741824 Sep 07 10:54:03 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c05897d-5c25-4b2e-a68f-63be0cb83585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1074a345-633a-4a30-8be3-a0500b0ef3ac', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a46ad4-b929-4424-80bc-f117cc4d4196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Volume volume-1074a345-633a-4a30-8be3-a0500b0ef3ac (1074a345-633a-4a30-8be3-a0500b0ef3ac): created successfully Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a46ad4-b929-4424-80bc-f117cc4d4196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Flow 'volume_create_manager' (fa6911d3-03b7-45d1-8102-453be11048f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-07ace479-f2cc-4ea9-83c8-1244f692670f tempest-VolumesListAdminTestJSON-789507282 None] Created volume successfully. Sep 07 10:54:04 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:04 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Acquiring lock "cinder-1074a345-633a-4a30-8be3-a0500b0ef3ac-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Lock "cinder-1074a345-633a-4a30-8be3-a0500b0ef3ac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:04 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.460s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Acquiring lock "cinder-quobyte-1074a345-633a-4a30-8be3-a0500b0ef3ac" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:04 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb Sep 07 10:54:04 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Lock "cinder-quobyte-1074a345-633a-4a30-8be3-a0500b0ef3ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:04 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a 1073741824" returned: 0 in 0.554s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "cinder-01622ea6-e344-4a46-b2e7-7d7ec00c69ef-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[617acdf5-668e-4dec-93cc-a4ed6c902ec5]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-01622ea6-e344-4a46-b2e7-7d7ec00c69ef-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:04 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a Sep 07 10:54:04 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "cinder-quobyte-01622ea6-e344-4a46-b2e7-7d7ec00c69ef" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-quobyte-01622ea6-e344-4a46-b2e7-7d7ec00c69ef" acquired by "delete_volume" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee24c9ea-c52d-4835-8a6e-7806c4a6d331]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:04 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac Sep 07 10:54:04 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:04 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef Sep 07 10:54:04 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:04 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb" returned: 0 in 0.413s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:04 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb Sep 07 10:54:04 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:04 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a" returned: 0 in 0.298s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef8e2ef-f501-46ee-8c12-7504458d270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3bb73e-9501-404e-8507-402025a2fc3a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7df5cf-41bf-4b3b-a706-b629239acb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:04 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Volume volume-ba3bb73e-9501-404e-8507-402025a2fc3a (ba3bb73e-9501-404e-8507-402025a2fc3a): created successfully Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7df5cf-41bf-4b3b-a706-b629239acb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:04 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Flow 'volume_create_manager' (e134262d-9ffc-4614-937d-e661769b9d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac" returned: 0 in 0.452s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2fb63998-2012-4b6c-afd7-5b6a609933e0 tempest-VolumeQuotasAdminTestJSON-1966122240 None] Created volume successfully. Sep 07 10:54:05 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac Sep 07 10:54:05 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:05 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef" returned: 0 in 0.395s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:05 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef Sep 07 10:54:05 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:05 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.b0c69bba-61ff-4146-ba57-473fc7b066bb" returned: 0 in 0.309s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-b0c69bba-61ff-4146-ba57-473fc7b066bb" released by "_delete_snapshot" :: held 1.774s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" released by "delete_snapshot" :: held 1.800s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:05 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1074a345-633a-4a30-8be3-a0500b0ef3ac" returned: 0 in 0.279s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Created reservations ['47bf44e0-9cf7-4dff-919d-b76fa90d786c', '50b79308-ba67-4a0d-973f-099f60e71294', '93652f8e-20cd-489a-a4e9-293497072c97', '4d999e2b-e91b-43af-87a6-8beb97f6fe93'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Lock "cinder-quobyte-1074a345-633a-4a30-8be3-a0500b0ef3ac" released by "delete_volume" :: held 0.807s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Delete snapshot completed successfully. Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-39b5a85b-72ed-4f37-bcc6-d96d30f09890 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-b0c69bba-61ff-4146-ba57-473fc7b066bb-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Created reservations ['ca40215d-5084-4db4-a7ef-e345a26e81c8', '69116baa-5606-4bba-821a-8f60822147db', '92a0e276-ad23-47ef-b0c7-de9182eb789d', 'f719e432-d864-4695-8331-7b26b4e77a18'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:05 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-01622ea6-e344-4a46-b2e7-7d7ec00c69ef" returned: 0 in 0.267s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-quobyte-01622ea6-e344-4a46-b2e7-7d7ec00c69ef" released by "delete_volume" :: held 0.706s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Created reservations ['8364641b-6aa4-449f-8590-a971d224bac6', 'b2bf58aa-49b3-4878-a365-d8449258cdde', '60cee263-247e-414a-b845-30cfdf9760a6', 'ca2ebf8b-77e7-4b66-ac17-01969e88d3f7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:05 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:05 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:05 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:05 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:05 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.390s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Deleted volume successfully. Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-37b179bb-7377-45b2-95be-18267da452a5 tempest-VolumesListAdminTestJSON-789507282 None] Lock "cinder-1074a345-633a-4a30-8be3-a0500b0ef3ac-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Creating offline snapshot ba62fa5d-4a31-42c7-adf0-d7668c0317b8 of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1c40f-426c-4e3b-a63e-9a8268b2906a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:05 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.421s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:06 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Deleted volume successfully. Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-12f7a771-4ba5-4ba3-a614-f6f851239a60 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-01622ea6-e344-4a46-b2e7-7d7ec00c69ef-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:06 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:06 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "cinder-2003bd5d-ea19-4b0d-9027-15a193fbdd60-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-2003bd5d-ea19-4b0d-9027-15a193fbdd60-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "cinder-quobyte-2003bd5d-ea19-4b0d-9027-15a193fbdd60" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-quobyte-2003bd5d-ea19-4b0d-9027-15a193fbdd60" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f14e92-843b-4b26-b356-56098b4a6aa2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:06 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 Sep 07 10:54:06 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:06 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.468s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:06 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 1G Sep 07 10:54:06 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:06 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c60a3b0d-e314-462b-ac3e-0ac48070777f tempest-VolumeQuotasAdminTestJSON-1254787141 None] Transfer volume completed successfully. Sep 07 10:54:06 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60" returned: 0 in 0.419s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:06 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60 Sep 07 10:54:06 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:06 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2003bd5d-ea19-4b0d-9027-15a193fbdd60" returned: 0 in 0.306s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-quobyte-2003bd5d-ea19-4b0d-9027-15a193fbdd60" released by "delete_volume" :: held 0.790s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:06 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 1G" returned: 0 in 0.539s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:07 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 Sep 07 10:54:07 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Acquiring lock "cinder-ba3bb73e-9501-404e-8507-402025a2fc3a-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Lock "cinder-ba3bb73e-9501-404e-8507-402025a2fc3a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Created reservations ['3ab7829a-9597-40a9-b382-fa1d10810db9', '838c73e3-9dfc-4590-9810-c8495c8af8c0', '6b6ac2dd-4342-4d31-a6b7-78fb6bf33ff1', 'a55af6f0-749a-400b-8a0a-18fc85ad788f'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Acquiring lock "cinder-quobyte-ba3bb73e-9501-404e-8507-402025a2fc3a" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Lock "cinder-quobyte-ba3bb73e-9501-404e-8507-402025a2fc3a" acquired by "delete_volume" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e23f4c-d003-4a01-9fc7-bc745ec0d14d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:07 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:07 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:07 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a Sep 07 10:54:07 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:07 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8" returned: 0 in 0.376s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:07 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 is being set with open permissions: ugo+rw Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:07 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 Sep 07 10:54:07 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "cinder-f02dabf2-f434-457c-bb64-b8f5639beb4e-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-f02dabf2-f434-457c-bb64-b8f5639beb4e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "cinder-quobyte-f02dabf2-f434-457c-bb64-b8f5639beb4e" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-quobyte-f02dabf2-f434-457c-bb64-b8f5639beb4e" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:07 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df51fe7-285c-4304-986b-e9d7a36dbe0d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.373s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Deleted volume successfully. Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6799467b-05c6-4f93-9ad6-7dcf131b77ee tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-2003bd5d-ea19-4b0d-9027-15a193fbdd60-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:07 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8" returned: 0 in 0.297s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:07 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a" returned: 0 in 0.513s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:07 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e Sep 07 10:54:07 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:07 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a Sep 07 10:54:07 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9a573b40-d367-438c-890e-ae2bc5ab77c2 tempest-SnapshotsActionsTest-210957374 None] Create snapshot completed successfully Sep 07 10:54:07 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ba3bb73e-9501-404e-8507-402025a2fc3a" returned: 0 in 0.267s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:08 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Lock "cinder-quobyte-ba3bb73e-9501-404e-8507-402025a2fc3a" released by "delete_volume" :: held 0.832s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e" returned: 0 in 0.422s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:08 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e Sep 07 10:54:08 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Created reservations ['263d8a48-65ea-4af6-aa48-9913e2f762b1', '8bb473c9-c3fa-4a62-86a9-19fe595c63c3', '197388f6-a7f7-4b61-8c53-5b453bb5109a', '5843f670-87d2-4355-953c-4cc8cca251e7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:08 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:08 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:08 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f02dabf2-f434-457c-bb64-b8f5639beb4e" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-quobyte-f02dabf2-f434-457c-bb64-b8f5639beb4e" released by "delete_volume" :: held 0.844s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-ba62fa5d-4a31-42c7-adf0-d7668c0317b8-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:08 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.378s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Created reservations ['bc7882f8-4052-4644-b99b-57f36b7888bc', '37bb7e8d-c875-4b83-ae5b-f5f37d5e3648', 'bc66d3d1-429b-44e2-a62a-aa130052f433', 'ca8be7d6-55aa-40a4-a1c8-9123cf6606ef'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:08 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Deleted volume successfully. Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-ba62fa5d-4a31-42c7-adf0-d7668c0317b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-35d1d0a2-68b1-4bc3-aab4-8324336ea46e tempest-VolumeQuotasAdminTestJSON-592830639 None] Lock "cinder-ba3bb73e-9501-404e-8507-402025a2fc3a-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-ba62fa5d-4a31-42c7-adf0-d7668c0317b8" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-ba62fa5d-4a31-42c7-adf0-d7668c0317b8" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Deleting offline snapshot ba62fa5d-4a31-42c7-adf0-d7668c0317b8 of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] snapshot_file for this snap is: volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07ebaa4-5f63-4a5d-83aa-b05fe39ab409]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:08 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:08 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:08 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 Sep 07 10:54:08 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:09 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:09 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Deleted volume successfully. Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-71bbdd4b-f863-4c18-a69e-adfbb7bf01c2 tempest-VolumesListAdminTestJSON-1546322178 None] Lock "cinder-f02dabf2-f434-457c-bb64-b8f5639beb4e-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:09 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8" returned: 0 in 0.484s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13c356-994b-495e-8b01-cc6ca948d0ed]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:09 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:09 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:09 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.414s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:09 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 Sep 07 10:54:09 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:10 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8" returned: 0 in 0.519s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:10 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8 Sep 07 10:54:10 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:10 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.ba62fa5d-4a31-42c7-adf0-d7668c0317b8" returned: 0 in 0.315s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-ba62fa5d-4a31-42c7-adf0-d7668c0317b8" released by "_delete_snapshot" :: held 1.926s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:10 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" released by "delete_snapshot" :: held 1.993s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:10 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Created reservations ['02b4ea95-16e9-46cc-9b2c-778bc96f002e', 'b5371967-7646-4558-9f13-06e07e614a8f', '2dfb79db-145b-4a99-9b70-e8d4600a818f', '3d9aae21-df11-441d-a62b-ce1ccbf14d3d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Delete snapshot completed successfully. Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c414b193-a9df-4164-8dfe-1f0cc74a1673 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-ba62fa5d-4a31-42c7-adf0-d7668c0317b8-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:10 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.404s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 28 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:54:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Creating offline snapshot 43633a00-30ca-4805-9cce-1451b6d36740 of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0c392-9163-4b04-851a-b5dd5584a7dc]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:12 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:12 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:12 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.441s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:12 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 1G Sep 07 10:54:12 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:13 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 1G" returned: 0 in 0.563s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:13 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 Sep 07 10:54:13 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:13 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740" returned: 0 in 0.479s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:13 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 is being set with open permissions: ugo+rw Sep 07 10:54:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:13 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 Sep 07 10:54:13 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Flow 'volume_create_manager' (78ec722e-3924-4a20-9586-692878f9e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbcc7a0-8de0-49d8-83c5-33d9110dd345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:14 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740" returned: 0 in 0.445s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbcc7a0-8de0-49d8-83c5-33d9110dd345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2128666411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6872702e-9f11-4626-8eae-b0f4a4eb9e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fe921bf7e44f028128eb2e617e06e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:14Z,use_quota=True,user_id='d43581dbffbe4a8da1679038c8d55020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a679e55b-df77-4cc8-b566-af26f1e3c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a679e55b-df77-4cc8-b566-af26f1e3c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb31700-751b-4415-9596-7f883df0a6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb31700-751b-4415-9596-7f883df0a6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6872702e-9f11-4626-8eae-b0f4a4eb9e6d', 'volume_name': 'volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265c3945-bde0-4685-9507-e4ab910decb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265c3945-bde0-4685-9507-e4ab910decb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9242369-82d8-4ee4-8679-594b721d0c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:14 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Volume 6872702e-9f11-4626-8eae-b0f4a4eb9e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d', 'volume_size': 1} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2128666411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6872702e-9f11-4626-8eae-b0f4a4eb9e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fe921bf7e44f028128eb2e617e06e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:14Z,use_quota=True,user_id='d43581dbffbe4a8da1679038c8d55020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Creating volume 6872702e-9f11-4626-8eae-b0f4a4eb9e6d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:14 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:14 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d 1073741824 Sep 07 10:54:14 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-885fcfb6-bf74-4f60-82be-d4c09b1c5f35 tempest-SnapshotsActionsTest-210957374 None] Create snapshot completed successfully Sep 07 10:54:14 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d 1073741824" returned: 0 in 0.534s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:14 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d Sep 07 10:54:14 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:15 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d" returned: 0 in 0.301s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9242369-82d8-4ee4-8679-594b721d0c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33756bc6-8a8c-4fa5-8704-6bd0e2be8d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:15 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Volume volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d (6872702e-9f11-4626-8eae-b0f4a4eb9e6d): created successfully Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33756bc6-8a8c-4fa5-8704-6bd0e2be8d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Flow 'volume_create_manager' (78ec722e-3924-4a20-9586-692878f9e140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5c624e71-5b6d-4d82-a4c5-40f5d1a992c0 tempest-AttachVolumeTestJSON-390571070 None] Created volume successfully. Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-43633a00-30ca-4805-9cce-1451b6d36740-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-43633a00-30ca-4805-9cce-1451b6d36740-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Acquiring lock "cinder-quobyte-43633a00-30ca-4805-9cce-1451b6d36740" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-43633a00-30ca-4805-9cce-1451b6d36740" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Deleting offline snapshot 43633a00-30ca-4805-9cce-1451b6d36740 of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] snapshot_file for this snap is: volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a951f84-9e83-4410-be65-3d6ba6ba6b60]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:15 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 Sep 07 10:54:15 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:15 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740" returned: 0 in 0.415s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c691698-2718-4f47-83be-e2b6b0d7b52b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:16 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:16 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:16 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.538s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:16 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 Sep 07 10:54:16 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:17 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740" returned: 0 in 0.469s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:17 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740 Sep 07 10:54:17 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:17 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.43633a00-30ca-4805-9cce-1451b6d36740" returned: 0 in 0.314s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-43633a00-30ca-4805-9cce-1451b6d36740" released by "_delete_snapshot" :: held 1.878s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" released by "delete_snapshot" :: held 1.917s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-e8609707-6133-485e-92c7-50bb91db22c4 req-2e52e88a-a3be-4af8-936e-cf15645f0628 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-e8609707-6133-485e-92c7-50bb91db22c4 req-2e52e88a-a3be-4af8-936e-cf15645f0628 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-e8609707-6133-485e-92c7-50bb91db22c4 req-2e52e88a-a3be-4af8-936e-cf15645f0628 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-e8609707-6133-485e-92c7-50bb91db22c4 req-2e52e88a-a3be-4af8-936e-cf15645f0628 tempest-AttachVolumeTestJSON-390571070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65e71f99-5643-4143-9276-d08cdf2568b0', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Created reservations ['2ae1dbbb-db6e-4375-807b-9e14cb9cdf26', '990e4b8c-b245-42df-a8eb-3157bce76555', '3ab6d1c2-b5fb-4fc3-b318-f4f02eb0350e', 'cce52af5-5c39-490c-93bf-3b64b18a88f9'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-e8609707-6133-485e-92c7-50bb91db22c4 req-2e52e88a-a3be-4af8-936e-cf15645f0628 tempest-AttachVolumeTestJSON-390571070 None] attachment_update completed successfully. Sep 07 10:54:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Delete snapshot completed successfully. Sep 07 10:54:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d5c997c-a817-4ba2-82a8-6aeb8b2d4bd3 tempest-SnapshotsActionsTest-1103465946 None] Lock "cinder-43633a00-30ca-4805-9cce-1451b6d36740-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "cinder-8719c824-f068-4919-a2c8-363e60e93a4e-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-8719c824-f068-4919-a2c8-363e60e93a4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "cinder-quobyte-8719c824-f068-4919-a2c8-363e60e93a4e" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Flow 'volume_create_manager' (3cfda387-7935-478b-b9d4-6774ac1f1e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809cf92-8b84-4839-b61d-6384af4c0280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-quobyte-8719c824-f068-4919-a2c8-363e60e93a4e" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Deleting offline snapshot 8719c824-f068-4919-a2c8-363e60e93a4e of volume 7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] snapshot_file for this snap is: volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809cf92-8b84-4839-b61d-6384af4c0280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1230450383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a09b3d3-e4dd-40d7-86bb-6531e629f136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f7d6dc4c454f6c886865c73a667979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:18Z,use_quota=True,user_id='8cb20574b77744a39282d40225c68f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c64098e-6395-4572-847a-08274d7dbfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c64098e-6395-4572-847a-08274d7dbfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cb1e3f-ed76-4568-910c-2b6ea88291e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cb1e3f-ed76-4568-910c-2b6ea88291e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a09b3d3-e4dd-40d7-86bb-6531e629f136', 'volume_name': 'volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776196f3-c8b7-49b8-9ccf-ebc491c071af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776196f3-c8b7-49b8-9ccf-ebc491c071af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1346b905-0692-479f-a271-f3f314be2aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:18 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Volume 7a09b3d3-e4dd-40d7-86bb-6531e629f136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136', 'volume_size': 1} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1230450383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a09b3d3-e4dd-40d7-86bb-6531e629f136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f7d6dc4c454f6c886865c73a667979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:18Z,use_quota=True,user_id='8cb20574b77744a39282d40225c68f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Creating volume 7a09b3d3-e4dd-40d7-86bb-6531e629f136 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:18 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61c2674-9511-432f-9a62-c22dcefc6a1c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:18 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 1073741824 Sep 07 10:54:18 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:18 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:18 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:19 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.442s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f368bc9-fdad-417d-b78a-276816b26364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50683e1-e388-4922-be50-0f1699cf5609]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:19 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 1073741824" returned: 0 in 0.520s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:19 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 Sep 07 10:54:19 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:19 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 Sep 07 10:54:19 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:19 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136" returned: 0 in 0.340s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1346b905-0692-479f-a271-f3f314be2aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ff927d-94c1-4ce3-aae0-3ec2bde06046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Volume volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 (7a09b3d3-e4dd-40d7-86bb-6531e629f136): created successfully Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ff927d-94c1-4ce3-aae0-3ec2bde06046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:19 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Flow 'volume_create_manager' (3cfda387-7935-478b-b9d4-6774ac1f1e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364" returned: 0 in 0.469s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e07ee6d3-432f-4355-b326-97f17c8034d8 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Created volume successfully. Sep 07 10:54:19 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:19 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:20 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.466s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:20 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e Sep 07 10:54:20 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Flow 'volume_create_manager' (ba318bf0-f302-4997-b6f7-62adf41237f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56185770-c09b-46f8-86dc-6e62c4ed1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56185770-c09b-46f8-86dc-6e62c4ed1e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-988206122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b397c5cc-d651-43ee-86da-9be5b106892f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fe921bf7e44f028128eb2e617e06e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:20Z,use_quota=True,user_id='d43581dbffbe4a8da1679038c8d55020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ff7d5-3253-4b22-8cb6-f74bf0a31e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ff7d5-3253-4b22-8cb6-f74bf0a31e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e943de96-4a4e-4596-a7fb-b635a6c87a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e943de96-4a4e-4596-a7fb-b635a6c87a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b397c5cc-d651-43ee-86da-9be5b106892f', 'volume_name': 'volume-b397c5cc-d651-43ee-86da-9be5b106892f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bef4055-1a2a-42a8-b502-abfaf8a97f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bef4055-1a2a-42a8-b502-abfaf8a97f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7613dc-165b-431d-b425-ff7d9c21de84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:20 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Volume b397c5cc-d651-43ee-86da-9be5b106892f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b397c5cc-d651-43ee-86da-9be5b106892f', 'volume_size': 1} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-988206122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b397c5cc-d651-43ee-86da-9be5b106892f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fe921bf7e44f028128eb2e617e06e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:20Z,use_quota=True,user_id='d43581dbffbe4a8da1679038c8d55020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Creating volume b397c5cc-d651-43ee-86da-9be5b106892f {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:20 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:20 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f 1073741824 Sep 07 10:54:20 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:20 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364.8719c824-f068-4919-a2c8-363e60e93a4e" returned: 0 in 0.358s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-quobyte-8719c824-f068-4919-a2c8-363e60e93a4e" released by "_delete_snapshot" :: held 2.037s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" released by "delete_snapshot" :: held 2.113s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Created reservations ['3a0da945-1002-4b0c-83a9-eef4f073f7ea', '3b80cbf2-eb4b-47c6-8189-a12fcc66c08c', '0da743b8-cf67-4f03-b7d6-e51d697ff6ad', 'b46e5393-d6dd-40d0-bf69-8d7f968c60a2'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Delete snapshot completed successfully. Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d9a697ec-fb54-4ef4-9443-69875b1922be tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-8719c824-f068-4919-a2c8-363e60e93a4e-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:20 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f 1073741824" returned: 0 in 0.566s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:21 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f Sep 07 10:54:21 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:21 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f" returned: 0 in 0.274s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7613dc-165b-431d-b425-ff7d9c21de84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b397c5cc-d651-43ee-86da-9be5b106892f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63873518-2e0b-439f-b397-0bcfbef3e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Volume volume-b397c5cc-d651-43ee-86da-9be5b106892f (b397c5cc-d651-43ee-86da-9be5b106892f): created successfully Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63873518-2e0b-439f-b397-0bcfbef3e98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Flow 'volume_create_manager' (ba318bf0-f302-4997-b6f7-62adf41237f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Acquiring lock "cinder-7a09b3d3-e4dd-40d7-86bb-6531e629f136-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-afd2e9cd-b94f-4083-9e77-a0bbe5a7f63f tempest-AttachVolumeTestJSON-390571070 None] Created volume successfully. Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "cinder-7a09b3d3-e4dd-40d7-86bb-6531e629f136-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Acquiring lock "cinder-quobyte-7a09b3d3-e4dd-40d7-86bb-6531e629f136" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "cinder-quobyte-7a09b3d3-e4dd-40d7-86bb-6531e629f136" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00c2c9-1be8-4144-9faa-79aabfba9a24]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:21 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 Sep 07 10:54:21 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Flow 'volume_create_manager' (c802d245-5f38-4c02-ab09-b806283bb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9146d85-6b56-4f11-bec2-2edb0e216df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9146d85-6b56-4f11-bec2-2edb0e216df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1647048344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d34614-db0a-4368-888c-265b31ff09ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2835ec46d2a0406aa1405e5d8e5e1e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:22Z,use_quota=True,user_id='f3a90112be704393a0ff3c761ed2279a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0676e706-2dee-467d-9325-12f7ec3a5824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0676e706-2dee-467d-9325-12f7ec3a5824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2419d1a9-eccd-47f6-9bae-5e6f8f85754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2419d1a9-eccd-47f6-9bae-5e6f8f85754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d34614-db0a-4368-888c-265b31ff09ad', 'volume_name': 'volume-d8d34614-db0a-4368-888c-265b31ff09ad', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ebaeb4-5da1-496d-b9b3-2711fadd62eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ebaeb4-5da1-496d-b9b3-2711fadd62eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7730c0b6-f504-42ef-a588-b836503d81f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Volume d8d34614-db0a-4368-888c-265b31ff09ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d34614-db0a-4368-888c-265b31ff09ad', 'volume_size': 1} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1647048344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d34614-db0a-4368-888c-265b31ff09ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2835ec46d2a0406aa1405e5d8e5e1e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:22Z,use_quota=True,user_id='f3a90112be704393a0ff3c761ed2279a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Creating volume d8d34614-db0a-4368-888c-265b31ff09ad {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:21 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:21 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "cinder-7f368bc9-fdad-417d-b78a-276816b26364-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136" returned: 0 in 0.411s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:21 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad 1073741824 Sep 07 10:54:21 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-7f368bc9-fdad-417d-b78a-276816b26364-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:21 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136 Sep 07 10:54:21 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0216b2f-24ef-4bd8-b08f-6e978700e472]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:22 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 Sep 07 10:54:22 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:22 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a09b3d3-e4dd-40d7-86bb-6531e629f136" returned: 0 in 0.295s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "cinder-quobyte-7a09b3d3-e4dd-40d7-86bb-6531e629f136" released by "delete_volume" :: held 0.745s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Created reservations ['6fc15f17-4dc1-4efd-95c2-84a64e6faf01', 'd480a5ac-dca7-4a22-a054-1feaf8c57ea7', '2ad76cad-cf7f-4975-9e83-7987ac748ff0', '267ac63d-f8c9-40fe-b9fd-e836c8d3773d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:22 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:22 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:22 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad 1073741824" returned: 0 in 0.574s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:22 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364" returned: 0 in 0.457s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:22 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364 Sep 07 10:54:22 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:22 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad Sep 07 10:54:22 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:22 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.404s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Deleted volume successfully. Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b1c85bf-c561-48a6-bce2-eae342624cd5 tempest-VolumeQuotasNegativeTestJSON-1899633506 None] Lock "cinder-7a09b3d3-e4dd-40d7-86bb-6531e629f136-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:22 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7f368bc9-fdad-417d-b78a-276816b26364" returned: 0 in 0.395s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-quobyte-7f368bc9-fdad-417d-b78a-276816b26364" released by "delete_volume" :: held 0.929s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:22 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad" returned: 0 in 0.447s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7730c0b6-f504-42ef-a588-b836503d81f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d34614-db0a-4368-888c-265b31ff09ad', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb4d1e2-5936-42c0-9641-ea4ca912f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:22 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Volume volume-d8d34614-db0a-4368-888c-265b31ff09ad (d8d34614-db0a-4368-888c-265b31ff09ad): created successfully Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb4d1e2-5936-42c0-9641-ea4ca912f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Flow 'volume_create_manager' (c802d245-5f38-4c02-ab09-b806283bb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Created reservations ['e8f5f3b7-53bf-41d0-be08-d5f67eabe6fa', 'da5abd7e-3369-4bb1-a736-8cde58fa61a3', 'd2e16c8c-2215-4370-886b-327707fb8f63', '7244fa41-9763-4478-ab87-49d37a1933d3'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:23 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b611ce69-e72e-4a6e-b9f8-a69e40bf06c9 tempest-VolumesListTestJSON-1529935903 None] Created volume successfully. Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:23 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:23 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-6f2c23aa-8252-4998-8c0c-8aa395891f8f req-b05ec481-88e6-44ec-b61b-6491cbcd8caa tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-6f2c23aa-8252-4998-8c0c-8aa395891f8f req-b05ec481-88e6-44ec-b61b-6491cbcd8caa tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-6f2c23aa-8252-4998-8c0c-8aa395891f8f req-b05ec481-88e6-44ec-b61b-6491cbcd8caa tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-6f2c23aa-8252-4998-8c0c-8aa395891f8f req-b05ec481-88e6-44ec-b61b-6491cbcd8caa tempest-AttachVolumeTestJSON-390571070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-b397c5cc-d651-43ee-86da-9be5b106892f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc6f521c-f386-49d4-a25c-67e107ca1d45', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:54:23 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.292s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:23 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-6f2c23aa-8252-4998-8c0c-8aa395891f8f req-b05ec481-88e6-44ec-b61b-6491cbcd8caa tempest-AttachVolumeTestJSON-390571070 None] attachment_update completed successfully. Sep 07 10:54:23 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Deleted volume successfully. Sep 07 10:54:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8f25466f-d3b7-4ba1-9774-cd2d1ce8dc6a tempest-SnapshotsActionsTest-210957374 None] Lock "cinder-7f368bc9-fdad-417d-b78a-276816b26364-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Flow 'volume_create_manager' (0526104e-fc7d-4054-9e51-3a01e8afa26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a9b37e-f59d-4711-add5-e341acbb8439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a9b37e-f59d-4711-add5-e341acbb8439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-541322040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad8642c-18cc-4e76-8a14-cacf5d6dc44b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2835ec46d2a0406aa1405e5d8e5e1e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:25Z,use_quota=True,user_id='f3a90112be704393a0ff3c761ed2279a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6779836b-a561-4105-b48b-709fabd8e4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6779836b-a561-4105-b48b-709fabd8e4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf51634f-5080-405e-a19a-cdefab5d6413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf51634f-5080-405e-a19a-cdefab5d6413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad8642c-18cc-4e76-8a14-cacf5d6dc44b', 'volume_name': 'volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef45a4e-a453-4a0f-82cf-804a1d25f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef45a4e-a453-4a0f-82cf-804a1d25f314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0a9724-64d3-42d2-8871-716ec0c9b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Volume dad8642c-18cc-4e76-8a14-cacf5d6dc44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b', 'volume_size': 1} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-541322040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad8642c-18cc-4e76-8a14-cacf5d6dc44b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2835ec46d2a0406aa1405e5d8e5e1e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:25Z,use_quota=True,user_id='f3a90112be704393a0ff3c761ed2279a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Creating volume dad8642c-18cc-4e76-8a14-cacf5d6dc44b {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:24 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b 1073741824 Sep 07 10:54:24 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:25 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b 1073741824" returned: 0 in 0.559s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:25 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b Sep 07 10:54:25 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-702283f7-23a8-47ef-a352-b928be2af2e6 req-9d40d910-d219-42dc-ad70-2d2d364eccb0 tempest-AttachVolumeTestJSON-390571070 None] Terminate volume connection completed successfully. Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-702283f7-23a8-47ef-a352-b928be2af2e6 req-9d40d910-d219-42dc-ad70-2d2d364eccb0 tempest-AttachVolumeTestJSON-390571070 None] Deleting attachment 65e71f99-5643-4143-9276-d08cdf2568b0. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:54:25 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b" returned: 0 in 0.328s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0a9724-64d3-42d2-8871-716ec0c9b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922ae1f7-f0ef-4f59-912c-310b3e37a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Volume volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b (dad8642c-18cc-4e76-8a14-cacf5d6dc44b): created successfully Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922ae1f7-f0ef-4f59-912c-310b3e37a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Flow 'volume_create_manager' (0526104e-fc7d-4054-9e51-3a01e8afa26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4a7f3a3c-0402-4705-8f92-9aaa37478d81 tempest-VolumesListTestJSON-1529935903 None] Created volume successfully. Sep 07 10:54:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-ef8cb02f-5385-4fab-8d8d-d3789afd5036 req-401d7d89-b11b-4b3e-a698-8d2214650e3c tempest-AttachVolumeTestJSON-390571070 None] Terminate volume connection completed successfully. Sep 07 10:54:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-ef8cb02f-5385-4fab-8d8d-d3789afd5036 req-401d7d89-b11b-4b3e-a698-8d2214650e3c tempest-AttachVolumeTestJSON-390571070 None] Deleting attachment cc6f521c-f386-49d4-a25c-67e107ca1d45. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Flow 'volume_create_manager' (3bb1b22e-5077-4254-9f48-244d1a9cc69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b90ccf4-b72a-41fb-9b01-9d64fdf8c671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b90ccf4-b72a-41fb-9b01-9d64fdf8c671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-360017462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fafa8e-f212-4f78-9c78-484f3f463685,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2835ec46d2a0406aa1405e5d8e5e1e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:27Z,use_quota=True,user_id='f3a90112be704393a0ff3c761ed2279a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe59849-ef90-4246-a9d1-45752d8ded5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe59849-ef90-4246-a9d1-45752d8ded5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3622419c-38a1-42d2-9077-afd4b6f62026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3622419c-38a1-42d2-9077-afd4b6f62026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fafa8e-f212-4f78-9c78-484f3f463685', 'volume_name': 'volume-92fafa8e-f212-4f78-9c78-484f3f463685', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b6d4e7-548e-44eb-90f8-5d0764ef5904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b6d4e7-548e-44eb-90f8-5d0764ef5904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e790db09-486f-4702-b1b2-290faf6be4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:27 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Volume 92fafa8e-f212-4f78-9c78-484f3f463685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fafa8e-f212-4f78-9c78-484f3f463685', 'volume_size': 1} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-360017462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fafa8e-f212-4f78-9c78-484f3f463685,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2835ec46d2a0406aa1405e5d8e5e1e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:27Z,use_quota=True,user_id='f3a90112be704393a0ff3c761ed2279a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Creating volume 92fafa8e-f212-4f78-9c78-484f3f463685 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:27 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:27 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 1073741824 Sep 07 10:54:27 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:28 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 1073741824" returned: 0 in 0.589s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:28 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 Sep 07 10:54:28 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:28 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685" returned: 0 in 0.391s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e790db09-486f-4702-b1b2-290faf6be4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fafa8e-f212-4f78-9c78-484f3f463685', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d33450-e587-4488-82ce-acf6f1789cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:28 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Volume volume-92fafa8e-f212-4f78-9c78-484f3f463685 (92fafa8e-f212-4f78-9c78-484f3f463685): created successfully Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d33450-e587-4488-82ce-acf6f1789cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Flow 'volume_create_manager' (3bb1b22e-5077-4254-9f48-244d1a9cc69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-565bbb29-dd1f-4c3f-ae2e-19f2e1e6e08f tempest-VolumesListTestJSON-1529935903 None] Created volume successfully. Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "cinder-92fafa8e-f212-4f78-9c78-484f3f463685-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Flow 'volume_create_manager' (a746188d-fd63-45be-8daf-20642a3ee78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c88880-13ee-4307-9bd5-17df49fff99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c88880-13ee-4307-9bd5-17df49fff99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-142339522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49309a2-7462-49d0-9b1c-08bbd65699a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f80a77fb94409fa6790157b5e2c86a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:32Z,use_quota=True,user_id='54ccb0e751034048a87310b5a827a56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9344ab4-191e-4571-80bb-927da418598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9344ab4-191e-4571-80bb-927da418598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9ee147-8162-4058-ac04-edecdc52a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9ee147-8162-4058-ac04-edecdc52a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49309a2-7462-49d0-9b1c-08bbd65699a8', 'volume_name': 'volume-d49309a2-7462-49d0-9b1c-08bbd65699a8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a3bab8-5d6a-4127-babb-4300cd9c02cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a3bab8-5d6a-4127-babb-4300cd9c02cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cb6fb-ae6e-42d2-8f16-016cb448a89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:32 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Volume d49309a2-7462-49d0-9b1c-08bbd65699a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49309a2-7462-49d0-9b1c-08bbd65699a8', 'volume_size': 1} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-142339522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49309a2-7462-49d0-9b1c-08bbd65699a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f80a77fb94409fa6790157b5e2c86a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:32Z,use_quota=True,user_id='54ccb0e751034048a87310b5a827a56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Creating volume d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:32 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-92fafa8e-f212-4f78-9c78-484f3f463685-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:32 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 1073741824 Sep 07 10:54:32 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "cinder-quobyte-92fafa8e-f212-4f78-9c78-484f3f463685" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-quobyte-92fafa8e-f212-4f78-9c78-484f3f463685" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[436785de-4846-4722-b0ac-dfc36f3b24a8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:32 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 Sep 07 10:54:32 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:32 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 1073741824" returned: 0 in 0.543s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:33 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685" returned: 0 in 0.499s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:33 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 Sep 07 10:54:33 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:33 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685 Sep 07 10:54:33 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:33 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8" returned: 0 in 0.343s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:33 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cb6fb-ae6e-42d2-8f16-016cb448a89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49309a2-7462-49d0-9b1c-08bbd65699a8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b389d22-7ce9-4cdb-9317-ae6d509a6540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-92fafa8e-f212-4f78-9c78-484f3f463685" returned: 0 in 0.365s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-quobyte-92fafa8e-f212-4f78-9c78-484f3f463685" released by "delete_volume" :: held 0.920s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:33 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Volume volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 (d49309a2-7462-49d0-9b1c-08bbd65699a8): created successfully Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b389d22-7ce9-4cdb-9317-ae6d509a6540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Flow 'volume_create_manager' (a746188d-fd63-45be-8daf-20642a3ee78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8e5a52e3-5ac5-4a8f-8de0-2e4af9aeb6c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Created volume successfully. Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Created reservations ['1563d114-ebbf-4064-a2b0-c7a7bb3496d8', 'e4992be6-b435-4749-a650-c8943bdca877', 'bc4410a0-0ce0-4473-9cc6-90e1c680e8a8', '9d80a0c1-68b1-4189-8dc7-2435f30dbaf9'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:33 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:33 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "cinder-b397c5cc-d651-43ee-86da-9be5b106892f-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-b397c5cc-d651-43ee-86da-9be5b106892f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "cinder-quobyte-b397c5cc-d651-43ee-86da-9be5b106892f" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-quobyte-b397c5cc-d651-43ee-86da-9be5b106892f" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981a536-1c96-43e1-83cb-9200841b126c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:33 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.272s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Deleted volume successfully. Sep 07 10:54:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3cfc2f7-f7e1-49cb-8ff5-fb0bedbd085a tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-92fafa8e-f212-4f78-9c78-484f3f463685-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:33 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f Sep 07 10:54:33 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:34 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f" returned: 0 in 0.363s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:34 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f Sep 07 10:54:34 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:34 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b397c5cc-d651-43ee-86da-9be5b106892f" returned: 0 in 0.295s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-quobyte-b397c5cc-d651-43ee-86da-9be5b106892f" released by "delete_volume" :: held 0.722s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Creating offline snapshot 3e261283-a3b7-491c-8af2-3172f285f171 of volume d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "cinder-dad8642c-18cc-4e76-8a14-cacf5d6dc44b-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f0688f-067f-4c5b-8467-3168fee691b8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Created reservations ['d4ff30a0-aa21-43d5-99a0-82b7c9f27a0d', '9e473a21-c21d-4a6d-9154-84495b87c3fd', '022c9a5e-eac3-4229-82c4-9a6da4504165', 'eb570d23-71e7-42a1-b456-0b0e66f2e843'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-dad8642c-18cc-4e76-8a14-cacf5d6dc44b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "cinder-quobyte-dad8642c-18cc-4e76-8a14-cacf5d6dc44b" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-quobyte-dad8642c-18cc-4e76-8a14-cacf5d6dc44b" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[83beed38-f8e1-4e0d-9b5a-79b7bec34563]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:34 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 Sep 07 10:54:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:34 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:34 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:34 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:35 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b Sep 07 10:54:35 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "cinder-6872702e-9f11-4626-8eae-b0f4a4eb9e6d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-6872702e-9f11-4626-8eae-b0f4a4eb9e6d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "cinder-quobyte-6872702e-9f11-4626-8eae-b0f4a4eb9e6d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-quobyte-6872702e-9f11-4626-8eae-b0f4a4eb9e6d" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d6ae2-f010-4747-a853-a54eb74c9973]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:35 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.436s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Deleted volume successfully. Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a8fb3c09-4831-421c-9bbc-bc73add8ad56 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-b397c5cc-d651-43ee-86da-9be5b106892f-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:35 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8" returned: 0 in 0.654s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:35 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b" returned: 0 in 0.513s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:35 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 1G Sep 07 10:54:35 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:35 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d Sep 07 10:54:35 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:35 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b Sep 07 10:54:35 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:35 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:35 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dad8642c-18cc-4e76-8a14-cacf5d6dc44b" returned: 0 in 0.345s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d" returned: 0 in 0.497s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-quobyte-dad8642c-18cc-4e76-8a14-cacf5d6dc44b" released by "delete_volume" :: held 0.949s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:35 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d Sep 07 10:54:35 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Created reservations ['82831502-3f34-42f2-b27b-b80a2ae59ad9', '8b6fbf5c-28d1-4c71-86ca-27d0e1c8aac4', '07ea7d01-619e-4840-a9a8-13e168129e97', '526ac1c7-46df-4f0a-ab49-d1c050fa928d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:35 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 1G" returned: 0 in 0.605s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:35 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 Sep 07 10:54:35 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:35 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:35 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:36 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6872702e-9f11-4626-8eae-b0f4a4eb9e6d" returned: 0 in 0.340s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-quobyte-6872702e-9f11-4626-8eae-b0f4a4eb9e6d" released by "delete_volume" :: held 0.920s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Created reservations ['4c61339a-4f2e-468e-b922-b85ce374b725', '2e9ccc87-9994-49cd-9a8c-102e1ef288d0', 'b818e359-c445-4140-b26b-d6b782a6c018', 'f8e271d0-4d7b-41c4-97f0-cb9e9d30bda9'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:36 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.317s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Deleted volume successfully. Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:36 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:36 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c2ad8da-6e56-40a4-b81e-ac36f9e46707 tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-dad8642c-18cc-4e76-8a14-cacf5d6dc44b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:36 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171" returned: 0 in 0.390s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 is being set with open permissions: ugo+rw Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:36 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 Sep 07 10:54:36 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:36 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.272s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Deleted volume successfully. Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-168f410c-d204-4a4e-aa40-cf494b679f19 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-6872702e-9f11-4626-8eae-b0f4a4eb9e6d-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:36 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171" returned: 0 in 0.273s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:36 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.info Sep 07 10:54:36 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:36 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.info" returned: 0 in 0.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.info is being set with open permissions: ugo+rw Sep 07 10:54:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:36 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.info Sep 07 10:54:36 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "cinder-d8d34614-db0a-4368-888c-265b31ff09ad-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-d8d34614-db0a-4368-888c-265b31ff09ad-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "cinder-quobyte-d8d34614-db0a-4368-888c-265b31ff09ad" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:37 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.info" returned: 0 in 0.269s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-quobyte-d8d34614-db0a-4368-888c-265b31ff09ad" acquired by "delete_volume" :: waited 0.037s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[956b30aa-f56e-442b-ac84-6178faee10e2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b05275c4-2bf6-4443-a21b-b4d1093152b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Create snapshot completed successfully Sep 07 10:54:37 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad Sep 07 10:54:37 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "cinder-e3d8528a-342a-4ab2-acf4-a925e97b51c3-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-e3d8528a-342a-4ab2-acf4-a925e97b51c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "cinder-quobyte-e3d8528a-342a-4ab2-acf4-a925e97b51c3" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-quobyte-e3d8528a-342a-4ab2-acf4-a925e97b51c3" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a265da-388e-47aa-8cee-1f69749c0471]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:37 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad" returned: 0 in 0.427s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:37 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad Sep 07 10:54:37 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:37 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 Sep 07 10:54:37 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:37 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:37 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3" returned: 0 in 0.413s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d8d34614-db0a-4368-888c-265b31ff09ad" returned: 0 in 0.324s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-quobyte-d8d34614-db0a-4368-888c-265b31ff09ad" released by "delete_volume" :: held 0.819s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:38 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3 Sep 07 10:54:38 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Created reservations ['bdd65766-555e-4f27-9e7b-4b9cf223553e', 'f110c204-8ceb-4aab-a7ef-8f9d646f9018', '620e2c7d-7b36-4c9f-b069-e90076d04a8e', 'e8a1a157-cac0-4100-a973-83778944ac0c'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:38 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:38 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "cinder-3e261283-a3b7-491c-8af2-3172f285f171-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:38 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e3d8528a-342a-4ab2-acf4-a925e97b51c3" returned: 0 in 0.428s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-quobyte-e3d8528a-342a-4ab2-acf4-a925e97b51c3" released by "delete_volume" :: held 0.889s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-3e261283-a3b7-491c-8af2-3172f285f171-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "cinder-quobyte-d49309a2-7462-49d0-9b1c-08bbd65699a8" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-quobyte-d49309a2-7462-49d0-9b1c-08bbd65699a8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "cinder-quobyte-3e261283-a3b7-491c-8af2-3172f285f171" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-quobyte-3e261283-a3b7-491c-8af2-3172f285f171" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Deleting offline snapshot 3e261283-a3b7-491c-8af2-3172f285f171 of volume d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] snapshot_file for this snap is: volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7e0822-534b-4af1-8219-39f6deebf2c9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Created reservations ['9caaedea-3ad1-4a4d-94a0-6fd97121ad75', '2bb970bc-dc15-426e-9482-2ee1d25a5cc5', '15687607-6167-4da8-ba71-3921306ffc18', 'd07f623e-3f3c-4dda-b1fb-2ecaae037157'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:38 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.464s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Deleted volume successfully. Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-aa4c6039-17a9-4dd6-8d13-2f55641d5bee tempest-VolumesListTestJSON-1529935903 None] Lock "cinder-d8d34614-db0a-4368-888c-265b31ff09ad-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:38 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 Sep 07 10:54:38 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:38 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:38 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:39 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.397s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Deleted volume successfully. Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c6850ebd-9d03-43ab-84bd-fefbdb8438d7 tempest-AttachVolumeTestJSON-390571070 None] Lock "cinder-e3d8528a-342a-4ab2-acf4-a925e97b51c3-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:39 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171" returned: 0 in 0.624s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49309a2-7462-49d0-9b1c-08bbd65699a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[473dc5e9-70ad-4882-911e-4a95fb690fb6]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:39 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 Sep 07 10:54:39 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:39 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8" returned: 0 in 0.466s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:39 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 Sep 07 10:54:39 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:40 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171" returned: 0 in 0.450s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:40 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171 Sep 07 10:54:40 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:40 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8.3e261283-a3b7-491c-8af2-3172f285f171" returned: 0 in 0.295s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-quobyte-3e261283-a3b7-491c-8af2-3172f285f171" released by "_delete_snapshot" :: held 1.969s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-quobyte-d49309a2-7462-49d0-9b1c-08bbd65699a8" released by "delete_snapshot" :: held 2.017s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:40 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Created reservations ['f2873707-d9be-456b-9a35-ca5b69e0d521', 'de8fb38f-5ac1-4239-bcbc-f188f5d36071', '71d177fc-b949-43b7-bdcc-3ead6dda4606', '70430d34-e12b-476b-8f05-5f53a6473cf9'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:40 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Delete snapshot completed successfully. Sep 07 10:54:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c1878832-b4bc-44be-be88-c3460c6cdfd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-3e261283-a3b7-491c-8af2-3172f285f171-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "cinder-d49309a2-7462-49d0-9b1c-08bbd65699a8-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-d49309a2-7462-49d0-9b1c-08bbd65699a8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "cinder-quobyte-d49309a2-7462-49d0-9b1c-08bbd65699a8" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-quobyte-d49309a2-7462-49d0-9b1c-08bbd65699a8" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:41 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a36fd0-30e8-40b7-b63f-ee530a214e37]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:42 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 Sep 07 10:54:42 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:42 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8" returned: 0 in 0.514s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:42 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8 Sep 07 10:54:42 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:42 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d49309a2-7462-49d0-9b1c-08bbd65699a8" returned: 0 in 0.303s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-quobyte-d49309a2-7462-49d0-9b1c-08bbd65699a8" released by "delete_volume" :: held 0.912s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Created reservations ['98408a52-2fc2-4382-bd70-de27a0f1153e', 'ee1f5247-457d-41ea-b073-1824ec8abcd0', '7e528769-ca85-42e0-ae86-ab6a0dc4e83b', 'db67e3f4-4e61-4df4-8d94-5b3f2862087c'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:43 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:43 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:43 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.450s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:43 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Deleted volume successfully. Sep 07 10:54:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6095797d-2c0b-44ab-b57a-ba9fb85b597f tempest-VolumeSnapshotQuotasNegativeTestJSON-476274417 None] Lock "cinder-d49309a2-7462-49d0-9b1c-08bbd65699a8-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=160,cinder:UPDATE=206,cinder:INSERT=56,cinder:DELETE=17 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=170,cinder:UPDATE=205,cinder:INSERT=44,cinder:DELETE=18 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Flow 'volume_create_manager' (4ebc00b0-c65d-418a-a198-c49ccd878e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb31ee4-108a-41b7-9789-a800052c11a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb31ee4-108a-41b7-9789-a800052c11a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-699845145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a0c6df-9295-4d3c-bca2-624768a730f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcca7ec8bac436184370797a308a504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:48Z,use_quota=True,user_id='a0a552848fcd4dfa81cfdfc15d4d9885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ab5a42-4f9a-439d-bdc3-a8d26ce3368b),volume_type_id=11ab5a42-4f9a-439d-bdc3-a8d26ce3368b)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79deb6b-fbde-419c-b346-bc1e74b631f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79deb6b-fbde-419c-b346-bc1e74b631f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f33f0c-7ed7-4fd1-aa65-ff4aadc53f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f33f0c-7ed7-4fd1-aa65-ff4aadc53f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a0c6df-9295-4d3c-bca2-624768a730f3', 'volume_name': 'volume-09a0c6df-9295-4d3c-bca2-624768a730f3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6de7d9c-b75e-4d2a-94e3-8aa3de3893b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6de7d9c-b75e-4d2a-94e3-8aa3de3893b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f686bc56-cdaa-4364-8800-f78b5c741ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:47 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Volume 09a0c6df-9295-4d3c-bca2-624768a730f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a0c6df-9295-4d3c-bca2-624768a730f3', 'volume_size': 1} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-699845145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a0c6df-9295-4d3c-bca2-624768a730f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcca7ec8bac436184370797a308a504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:54:48Z,use_quota=True,user_id='a0a552848fcd4dfa81cfdfc15d4d9885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ab5a42-4f9a-439d-bdc3-a8d26ce3368b),volume_type_id=11ab5a42-4f9a-439d-bdc3-a8d26ce3368b)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Creating volume 09a0c6df-9295-4d3c-bca2-624768a730f3 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:54:47 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:54:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:47 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 1073741824 Sep 07 10:54:47 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:48 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 1073741824" returned: 0 in 0.526s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:48 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 Sep 07 10:54:48 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:48 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3" returned: 0 in 0.524s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:54:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f686bc56-cdaa-4364-8800-f78b5c741ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a0c6df-9295-4d3c-bca2-624768a730f3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b228ed-efc7-4f72-b172-4cfe67920f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:54:48 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Volume volume-09a0c6df-9295-4d3c-bca2-624768a730f3 (09a0c6df-9295-4d3c-bca2-624768a730f3): created successfully Sep 07 10:54:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b228ed-efc7-4f72-b172-4cfe67920f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:54:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Flow 'volume_create_manager' (4ebc00b0-c65d-418a-a198-c49ccd878e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:54:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d057e323-3866-4d65-8f32-a0f7e730a197 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Created volume successfully. Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:50 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:50 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:50 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.339s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:50 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4aefcd8a-083f-40fb-8e1f-9bdf0ad84d88 tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Retype volume completed successfully. Sep 07 10:54:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Acquiring lock "cinder-09a0c6df-9295-4d3c-bca2-624768a730f3-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "cinder-09a0c6df-9295-4d3c-bca2-624768a730f3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Acquiring lock "cinder-quobyte-09a0c6df-9295-4d3c-bca2-624768a730f3" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:54:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "cinder-quobyte-09a0c6df-9295-4d3c-bca2-624768a730f3" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:54:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf88943-0a5a-4faf-bb56-bf4e28d86bd3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:54:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:52 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 Sep 07 10:54:52 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:52 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3" returned: 0 in 0.582s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:52 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3 Sep 07 10:54:52 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:52 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-09a0c6df-9295-4d3c-bca2-624768a730f3" returned: 0 in 0.357s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "cinder-quobyte-09a0c6df-9295-4d3c-bca2-624768a730f3" released by "delete_volume" :: held 1.018s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:54:53 devstack cinder-volume[87271]: WARNING cinder.quota [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:54:53 devstack cinder-volume[87271]: WARNING cinder.quota [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Created reservations ['0ddad9df-b679-4c0a-a9cc-04aac51208a8', '62613266-324d-435f-bab1-8f73c005addd', '1d85015f-c706-4215-9c3c-8b313de9fdee', '76c48e05-fc8b-4ba1-8368-ce4ca449215d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:54:53 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:54:53 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:54:53 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.342s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:54:53 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Deleted volume successfully. Sep 07 10:54:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f22f828d-c306-420f-9bcc-93889cf8f50e tempest-VolumeRetypeWithoutMigrationTest-1161979403 None] Lock "cinder-09a0c6df-9295-4d3c-bca2-624768a730f3-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:03 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1,cinder:SELECT=8 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:55:03 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=19,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:55:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:55:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:10 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:55:10 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:11 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.505s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Flow 'volume_create_manager' (e9643bf6-6bb3-4ae3-bb6a-0af8a413431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018c00a3-bd01-4ff6-b686-3e2d7d713022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018c00a3-bd01-4ff6-b686-3e2d7d713022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1552117877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b79870d-6033-4a2e-a9ea-b6b3e558543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e723ee4e1a4b41b9a0bd376cac71543d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:12Z,use_quota=True,user_id='0eb9f828050c4171a19506f6b29baec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40ff48ce-316e-48b2-88cb-dde6651b3c3d),volume_type_id=40ff48ce-316e-48b2-88cb-dde6651b3c3d)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba78d385-becd-49ee-856a-de481f963dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba78d385-becd-49ee-856a-de481f963dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdb30fd-f169-4829-aa99-cbf7caa69c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdb30fd-f169-4829-aa99-cbf7caa69c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b79870d-6033-4a2e-a9ea-b6b3e558543a', 'volume_name': 'volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6342fecd-29f6-45a6-b474-7872456dcf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6342fecd-29f6-45a6-b474-7872456dcf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ed62bf-2cda-45de-99e0-a8cd886ea9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:11 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Volume 5b79870d-6033-4a2e-a9ea-b6b3e558543a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a', 'volume_size': 1} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1552117877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b79870d-6033-4a2e-a9ea-b6b3e558543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e723ee4e1a4b41b9a0bd376cac71543d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:12Z,use_quota=True,user_id='0eb9f828050c4171a19506f6b29baec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40ff48ce-316e-48b2-88cb-dde6651b3c3d),volume_type_id=40ff48ce-316e-48b2-88cb-dde6651b3c3d)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Creating volume 5b79870d-6033-4a2e-a9ea-b6b3e558543a {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:11 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:11 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a 1073741824 Sep 07 10:55:11 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:12 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a 1073741824" returned: 0 in 0.631s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:12 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a Sep 07 10:55:12 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:12 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a" returned: 0 in 0.302s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ed62bf-2cda-45de-99e0-a8cd886ea9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7061908f-f5c3-4cf7-82b3-3a790ac96ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Volume volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a (5b79870d-6033-4a2e-a9ea-b6b3e558543a): created successfully Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7061908f-f5c3-4cf7-82b3-3a790ac96ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Flow 'volume_create_manager' (e9643bf6-6bb3-4ae3-bb6a-0af8a413431b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-baf9d106-24bb-4fdd-9754-dcdf1b6b8480 tempest-VolumeTypesAccessTest-355558274 None] Created volume successfully. Sep 07 10:55:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Acquiring lock "cinder-5b79870d-6033-4a2e-a9ea-b6b3e558543a-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Lock "cinder-5b79870d-6033-4a2e-a9ea-b6b3e558543a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Acquiring lock "cinder-quobyte-5b79870d-6033-4a2e-a9ea-b6b3e558543a" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Lock "cinder-quobyte-5b79870d-6033-4a2e-a9ea-b6b3e558543a" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:14 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[17488a91-8204-45c1-963e-0489d35d4e3e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:14 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a Sep 07 10:55:14 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:14 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a" returned: 0 in 0.554s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:14 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a Sep 07 10:55:14 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:14 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5b79870d-6033-4a2e-a9ea-b6b3e558543a" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Lock "cinder-quobyte-5b79870d-6033-4a2e-a9ea-b6b3e558543a" released by "delete_volume" :: held 1.003s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:15 devstack cinder-volume[87271]: WARNING cinder.quota [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-215154182 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-215154182, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:55:15 devstack cinder-volume[87271]: WARNING cinder.quota [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-215154182 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-215154182, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Created reservations ['495be2f1-524e-40d0-8154-81f71a8c6cb4', 'c41dd4d3-18dc-43d7-80e7-71e7fd4f6328', '0216f336-5ada-4bb7-88ae-b7f218f4cb9e', '1f1cd4e0-ef90-4490-8ca2-1d44de9356bb'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:15 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:55:15 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:15 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.609s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:55:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Deleted volume successfully. Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Flow 'volume_create_manager' (14867ca5-1271-4823-af91-d08805d5c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20d306d-4918-41ab-82a5-681a4e015559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5d6fceef-00c1-4068-bbf3-f515487d98fe tempest-VolumeTypesAccessTest-355558274 None] Lock "cinder-5b79870d-6033-4a2e-a9ea-b6b3e558543a-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20d306d-4918-41ab-82a5-681a4e015559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-631715731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1925c6d7-1dba-462b-9adf-ec1864955f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7232f716f8410b9f4ec9df8c90b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:16Z,use_quota=True,user_id='d59c8290261941ab82be7d12a159aead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a33324e1-1456-477b-b48f-a03d590415ac),volume_type_id=a33324e1-1456-477b-b48f-a03d590415ac)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be34a47-a419-4cd3-8999-6c17affb958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be34a47-a419-4cd3-8999-6c17affb958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8074bd87-4a88-43ce-815f-c3d86d285fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8074bd87-4a88-43ce-815f-c3d86d285fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1925c6d7-1dba-462b-9adf-ec1864955f50', 'volume_name': 'volume-1925c6d7-1dba-462b-9adf-ec1864955f50', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34296f05-9050-4509-b8c7-f331f164ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34296f05-9050-4509-b8c7-f331f164ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4452c98d-b98c-4d91-9f4d-48f64c2f6c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:16 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Volume 1925c6d7-1dba-462b-9adf-ec1864955f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1925c6d7-1dba-462b-9adf-ec1864955f50', 'volume_size': 1} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-631715731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1925c6d7-1dba-462b-9adf-ec1864955f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7232f716f8410b9f4ec9df8c90b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:16Z,use_quota=True,user_id='d59c8290261941ab82be7d12a159aead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a33324e1-1456-477b-b48f-a03d590415ac),volume_type_id=a33324e1-1456-477b-b48f-a03d590415ac)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Creating volume 1925c6d7-1dba-462b-9adf-ec1864955f50 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:16 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:16 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 1073741824 Sep 07 10:55:16 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Flow 'volume_create_manager' (9299fcb9-3d23-4fa0-a1b3-9f6b8dd6a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fca971-20d6-42a2-98b4-5ffa7d5d595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fca971-20d6-42a2-98b4-5ffa7d5d595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1727010565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f154557-d203-41a9-b14f-db56dc4168a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7232f716f8410b9f4ec9df8c90b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:17Z,use_quota=True,user_id='d59c8290261941ab82be7d12a159aead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebb6a1b-4aca-4c4d-adbe-3c003d31c843),volume_type_id=3ebb6a1b-4aca-4c4d-adbe-3c003d31c843)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824b2c6-d7bd-4369-81cc-19be974a1ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824b2c6-d7bd-4369-81cc-19be974a1ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1141f7b9-6e2d-48a0-97c0-10a5f3d29219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:17 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1141f7b9-6e2d-48a0-97c0-10a5f3d29219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f154557-d203-41a9-b14f-db56dc4168a4', 'volume_name': 'volume-1f154557-d203-41a9-b14f-db56dc4168a4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf491b0-7573-4683-affd-5570226884c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf491b0-7573-4683-affd-5570226884c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b852a35b-84e3-4168-8d12-1a5970c66b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:17 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Volume 1f154557-d203-41a9-b14f-db56dc4168a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f154557-d203-41a9-b14f-db56dc4168a4', 'volume_size': 1} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 1073741824" returned: 0 in 1.006s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:17 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 Sep 07 10:55:17 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:17 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50" returned: 0 in 0.339s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1727010565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f154557-d203-41a9-b14f-db56dc4168a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7232f716f8410b9f4ec9df8c90b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:17Z,use_quota=True,user_id='d59c8290261941ab82be7d12a159aead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebb6a1b-4aca-4c4d-adbe-3c003d31c843),volume_type_id=3ebb6a1b-4aca-4c4d-adbe-3c003d31c843)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Creating volume 1f154557-d203-41a9-b14f-db56dc4168a4 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:17 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4452c98d-b98c-4d91-9f4d-48f64c2f6c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1925c6d7-1dba-462b-9adf-ec1864955f50', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:17 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 1073741824 Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f726ef8-d8a3-4264-a283-ad1a76fef18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:17 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:17 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Volume volume-1925c6d7-1dba-462b-9adf-ec1864955f50 (1925c6d7-1dba-462b-9adf-ec1864955f50): created successfully Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f726ef8-d8a3-4264-a283-ad1a76fef18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Flow 'volume_create_manager' (14867ca5-1271-4823-af91-d08805d5c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-254a9f94-5558-4a09-94cf-6a8d0cff9e02 tempest-TestInstancesWithCinderVolumes-220368711 None] Created volume successfully. Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Flow 'volume_create_manager' (34ccf473-a26c-4063-8f9c-49b093643852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e40cd70-abfc-41e9-be85-5ef26c563faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e40cd70-abfc-41e9-be85-5ef26c563faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-601664689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4c6ea8-64c0-4a4d-86db-107754f9be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7232f716f8410b9f4ec9df8c90b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:18Z,use_quota=True,user_id='d59c8290261941ab82be7d12a159aead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7e6a50-4d62-405d-ad70-3043b26a2e72),volume_type_id=dd7e6a50-4d62-405d-ad70-3043b26a2e72)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a224c4-dafc-4a93-8adf-71758d452390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a224c4-dafc-4a93-8adf-71758d452390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1328e1-402b-4129-990b-a2c7e7bde2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:55:18 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 1073741824" returned: 0 in 0.796s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:18 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 Sep 07 10:55:18 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:18 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4" returned: 0 in 0.525s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b852a35b-84e3-4168-8d12-1a5970c66b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f154557-d203-41a9-b14f-db56dc4168a4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4850826e-9d20-49ed-adff-dff3a2693daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Volume volume-1f154557-d203-41a9-b14f-db56dc4168a4 (1f154557-d203-41a9-b14f-db56dc4168a4): created successfully Sep 07 10:55:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4850826e-9d20-49ed-adff-dff3a2693daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Flow 'volume_create_manager' (9299fcb9-3d23-4fa0-a1b3-9f6b8dd6a602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1328e1-402b-4129-990b-a2c7e7bde2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e4c6ea8-64c0-4a4d-86db-107754f9be49', 'volume_name': 'volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49', 'volume_size': 1, 'image_id': '47601c25-ab08-49b9-b4d1-e6e83d17c980', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47601c25-ab08-49b9-b4d1-e6e83d17c980', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--862915812', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c7232f716f8410b9f4ec9df8c90b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47601c25-ab08-49b9-b4d1-e6e83d17c980', 'created_at': datetime.datetime(2026, 9, 7, 8, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47601c25-ab08-49b9-b4d1-e6e83d17c980/file', 'properties': {}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b882371-63bd-4e5b-ad98-179f1534fb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b882371-63bd-4e5b-ad98-179f1534fb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f32d9a-f099-4919-bbd3-261c36ca0e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Volume 7e4c6ea8-64c0-4a4d-86db-107754f9be49: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49', 'volume_size': 1, 'image_id': '47601c25-ab08-49b9-b4d1-e6e83d17c980', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47601c25-ab08-49b9-b4d1-e6e83d17c980', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--862915812', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c7232f716f8410b9f4ec9df8c90b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47601c25-ab08-49b9-b4d1-e6e83d17c980', 'created_at': datetime.datetime(2026, 9, 7, 8, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47601c25-ab08-49b9-b4d1-e6e83d17c980/file', 'properties': {}}, 'image_service': } Sep 07 10:55:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Trying to clone 7e4c6ea8-64c0-4a4d-86db-107754f9be49 from image 47601c25-ab08-49b9-b4d1-e6e83d17c980 at location (None, [{'url': 'file:///opt/stack/data/glance/images/47601c25-ab08-49b9-b4d1-e6e83d17c980', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:55:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8fbe282a-b757-44a9-9c64-a31a98dac94b tempest-TestInstancesWithCinderVolumes-220368711 None] Created volume successfully. Sep 07 10:55:23 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD, size 20.69 MB, duration 4.30 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:55:23 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Image download 20.69 MB at 4.81 MB/s Sep 07 10:55:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[88478d70-1669-4f1f-97e9-dc8ba67c28f4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:23 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD Sep 07 10:55:23 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:23 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:23 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Temporary image 47601c25-ab08-49b9-b4d1-e6e83d17c980 is fetched for user d59c8290261941ab82be7d12a159aead. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc1b0c4-2505-4342-bc92-0b518b75601b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:24 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD Sep 07 10:55:24 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:24 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-601664689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4c6ea8-64c0-4a4d-86db-107754f9be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7232f716f8410b9f4ec9df8c90b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:18Z,use_quota=True,user_id='d59c8290261941ab82be7d12a159aead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7e6a50-4d62-405d-ad70-3043b26a2e72),volume_type_id=dd7e6a50-4d62-405d-ad70-3043b26a2e72)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Creating volume 7e4c6ea8-64c0-4a4d-86db-107754f9be49 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:24 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 1073741824 Sep 07 10:55:24 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:25 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 1073741824" returned: 0 in 0.836s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:25 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 Sep 07 10:55:25 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:25 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49" returned: 0 in 0.439s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Attempting download of 47601c25-ab08-49b9-b4d1-e6e83d17c980 ((None, [{'url': 'file:///opt/stack/data/glance/images/47601c25-ab08-49b9-b4d1-e6e83d17c980', 'metadata': {}}])) to volume 7e4c6ea8-64c0-4a4d-86db-107754f9be49. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff40ab4-3c95-4bb6-b724-657848ef4d5f]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47601c25-ab08-49b9-b4d1-e6e83d17c980_a1pzlmfq {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:26 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47601c25-ab08-49b9-b4d1-e6e83d17c980_a1pzlmfq Sep 07 10:55:26 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:26 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47601c25-ab08-49b9-b4d1-e6e83d17c980_a1pzlmfq" returned: 0 in 0.530s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47601c25-ab08-49b9-b4d1-e6e83d17c980_a1pzlmfq {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:26 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47601c25-ab08-49b9-b4d1-e6e83d17c980_a1pzlmfq Sep 07 10:55:26 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:26 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47601c25-ab08-49b9-b4d1-e6e83d17c980_a1pzlmfq" returned: 1 in 0.408s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47601c25-ab08-49b9-b4d1-e6e83d17c980_a1pzlmfq' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:55:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea4ce41-0c4f-48bb-96a1-e41fb9867bea]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:27 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD Sep 07 10:55:27 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:27 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:27 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] 47601c25-ab08-49b9-b4d1-e6e83d17c980 was qcow2, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:55:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:27 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 Sep 07 10:55:27 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:30 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49" returned: 0 in 2.926s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:30 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47601c25-ab08-49b9-b4d1-e6e83d17c980_7w1njb9ldevstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:55:30 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Converted 112.00 MB image at 38.26 MB/s Sep 07 10:55:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:30 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 1G Sep 07 10:55:30 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:31 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 1G" returned: 0 in 0.687s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Downloaded image 47601c25-ab08-49b9-b4d1-e6e83d17c980 ((None, [{'url': 'file:///opt/stack/data/glance/images/47601c25-ab08-49b9-b4d1-e6e83d17c980', 'metadata': {}}])) to volume 7e4c6ea8-64c0-4a4d-86db-107754f9be49 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Temporary image 47601c25-ab08-49b9-b4d1-e6e83d17c980 for user d59c8290261941ab82be7d12a159aead is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Marking volume 7e4c6ea8-64c0-4a4d-86db-107754f9be49 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Copying metadata from image 47601c25-ab08-49b9-b4d1-e6e83d17c980 to 7e4c6ea8-64c0-4a4d-86db-107754f9be49. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Creating volume glance metadata for volume 7e4c6ea8-64c0-4a4d-86db-107754f9be49 backed by image 47601c25-ab08-49b9-b4d1-e6e83d17c980 with: {'image_id': '47601c25-ab08-49b9-b4d1-e6e83d17c980', 'image_name': 'tempest-scenario-img--862915812', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f32d9a-f099-4919-bbd3-261c36ca0e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49', 'volume_size': 1, 'image_id': '47601c25-ab08-49b9-b4d1-e6e83d17c980', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47601c25-ab08-49b9-b4d1-e6e83d17c980', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--862915812', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c7232f716f8410b9f4ec9df8c90b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47601c25-ab08-49b9-b4d1-e6e83d17c980', 'created_at': datetime.datetime(2026, 9, 7, 8, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47601c25-ab08-49b9-b4d1-e6e83d17c980/file', 'properties': {}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276cb2df-783e-4216-afb1-fd000c87e5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Volume volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 (7e4c6ea8-64c0-4a4d-86db-107754f9be49): created successfully Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276cb2df-783e-4216-afb1-fd000c87e5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Flow 'volume_create_manager' (34ccf473-a26c-4063-8f9c-49b093643852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-46b693e7-9a48-49b4-9719-79974ce9fde2 tempest-TestInstancesWithCinderVolumes-220368711 None] Created volume successfully. Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Flow 'volume_create_manager' (f50706b8-47de-4bc3-8531-d361a11ff688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c4a8dd-0d80-4d36-8869-e7801aab6926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c4a8dd-0d80-4d36-8869-e7801aab6926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-903093281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ee6b97-ebcb-46a7-8146-54ec3315451e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ab3f06a606426898e83fa6e217f914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:32Z,use_quota=True,user_id='4b0df7f7c3aa414fbf9421679bd8bd9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fa1243-5cbf-49bb-9e93-090df79bb4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fa1243-5cbf-49bb-9e93-090df79bb4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff65c116-df62-4a40-a325-4d623697f594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff65c116-df62-4a40-a325-4d623697f594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ee6b97-ebcb-46a7-8146-54ec3315451e', 'volume_name': 'volume-35ee6b97-ebcb-46a7-8146-54ec3315451e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735fab21-4d73-47a8-95d2-beab4f560447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735fab21-4d73-47a8-95d2-beab4f560447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a6a41f-1ce1-4379-bf08-0f5ac8ff02ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Volume 35ee6b97-ebcb-46a7-8146-54ec3315451e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ee6b97-ebcb-46a7-8146-54ec3315451e', 'volume_size': 1} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-903093281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ee6b97-ebcb-46a7-8146-54ec3315451e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ab3f06a606426898e83fa6e217f914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:32Z,use_quota=True,user_id='4b0df7f7c3aa414fbf9421679bd8bd9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Creating volume 35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:31 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:31 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e 1073741824 Sep 07 10:55:31 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:32 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e 1073741824" returned: 0 in 0.783s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:32 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e Sep 07 10:55:32 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:33 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e" returned: 0 in 0.412s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a6a41f-1ce1-4379-bf08-0f5ac8ff02ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ee6b97-ebcb-46a7-8146-54ec3315451e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75858a8f-b303-4701-a580-b32c8250fcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:33 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Volume volume-35ee6b97-ebcb-46a7-8146-54ec3315451e (35ee6b97-ebcb-46a7-8146-54ec3315451e): created successfully Sep 07 10:55:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75858a8f-b303-4701-a580-b32c8250fcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Flow 'volume_create_manager' (f50706b8-47de-4bc3-8531-d361a11ff688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-602edc37-48aa-4354-91a6-187bdba37669 tempest-VolumesDeleteCascade-220706020 None] Created volume successfully. Sep 07 10:55:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Creating offline snapshot ea829e7b-2982-46b8-a3bf-213c46832a71 of volume 35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:55:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4027d9c5-4eff-4b0f-9d11-97e3b373b1f0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:34 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e Sep 07 10:55:34 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:35 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e" returned: 0 in 0.523s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:35 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 1G Sep 07 10:55:35 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:35 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 1G" returned: 0 in 0.830s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee6b97-ebcb-46a7-8146-54ec3315451e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:35 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee6b97-ebcb-46a7-8146-54ec3315451e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 Sep 07 10:55:35 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-29ef53ed-e8b4-491f-81db-3c112224b323 req-96852c81-0641-464b-afc6-6b28ed4cdf14 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:36 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee6b97-ebcb-46a7-8146-54ec3315451e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71" returned: 0 in 0.667s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 is being set with open permissions: ugo+rw Sep 07 10:55:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:36 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 Sep 07 10:55:36 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:36 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71" returned: 0 in 0.393s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:37 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.info Sep 07 10:55:37 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:37 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.info" returned: 0 in 0.431s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:37 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.info is being set with open permissions: ugo+rw Sep 07 10:55:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:37 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.info Sep 07 10:55:37 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:37 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.info" returned: 0 in 0.390s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.391s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-29ef53ed-e8b4-491f-81db-3c112224b323 req-96852c81-0641-464b-afc6-6b28ed4cdf14 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.310s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-29ef53ed-e8b4-491f-81db-3c112224b323 req-96852c81-0641-464b-afc6-6b28ed4cdf14 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-04af381b-655c-4b0e-9aa4-8ffae6b49fbe tempest-VolumesDeleteCascade-220706020 None] Create snapshot completed successfully Sep 07 10:55:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-29ef53ed-e8b4-491f-81db-3c112224b323 req-96852c81-0641-464b-afc6-6b28ed4cdf14 tempest-TestInstancesWithCinderVolumes-220368711 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c754fe6-5cb2-4b81-a302-d3d1e303ad13', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:55:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-29ef53ed-e8b4-491f-81db-3c112224b323 req-96852c81-0641-464b-afc6-6b28ed4cdf14 tempest-TestInstancesWithCinderVolumes-220368711 None] attachment_update completed successfully. Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Creating offline snapshot 07d047aa-2fde-436e-8883-85bf34bc27fa of volume 35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[39551713-d641-4839-b005-1fa72aeb025f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:39 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 Sep 07 10:55:39 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:39 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71" returned: 0 in 0.518s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ee6b97-ebcb-46a7-8146-54ec3315451e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:55:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:39 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa 1G Sep 07 10:55:39 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:40 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa 1G" returned: 0 in 0.907s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:40 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa Sep 07 10:55:40 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:41 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa" returned: 0 in 0.573s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:41 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa is being set with open permissions: ugo+rw Sep 07 10:55:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:41 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa Sep 07 10:55:41 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:41 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa" returned: 0 in 0.372s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:41 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b7b3562e-e34f-4c78-83bc-c6ec1840fdba tempest-VolumesDeleteCascade-220706020 None] Create snapshot completed successfully Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-35ee6b97-ebcb-46a7-8146-54ec3315451e-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-35ee6b97-ebcb-46a7-8146-54ec3315451e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Performing cascade delete. {{(pid=87271) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-07d047aa-2fde-436e-8883-85bf34bc27fa-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-07d047aa-2fde-436e-8883-85bf34bc27fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-07d047aa-2fde-436e-8883-85bf34bc27fa" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-07d047aa-2fde-436e-8883-85bf34bc27fa" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Deleting offline snapshot 07d047aa-2fde-436e-8883-85bf34bc27fa of volume 35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] snapshot_file for this snap is: volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc93a26-2a47-4d01-b2eb-39be8e396d3a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:43 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa Sep 07 10:55:43 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:43 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa" returned: 0 in 0.486s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ee6b97-ebcb-46a7-8146-54ec3315451e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:55:43 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe3692e-bd6e-4e80-b14b-cc4fd6c504ee]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:43 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 Sep 07 10:55:43 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:43 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71" returned: 0 in 0.497s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ee6b97-ebcb-46a7-8146-54ec3315451e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:55:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:43 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa Sep 07 10:55:43 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:44 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa" returned: 0 in 0.632s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:44 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa Sep 07 10:55:44 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:44 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.07d047aa-2fde-436e-8883-85bf34bc27fa" returned: 0 in 0.388s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-07d047aa-2fde-436e-8883-85bf34bc27fa" released by "_delete_snapshot" :: held 2.151s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" released by "delete_snapshot" :: held 2.195s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Created reservations ['8f399ead-d20d-4fe5-a675-eaf58b3cdd26', '7dd4c978-2ad8-4534-b82f-60894e98a19e', 'a069b849-ee59-4a7d-90a7-5adcdcd19728', 'f613f3c8-f51f-443a-bb27-a1ae0febf295'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:55:45 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Delete snapshot completed successfully. Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-07d047aa-2fde-436e-8883-85bf34bc27fa-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-ea829e7b-2982-46b8-a3bf-213c46832a71-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-ea829e7b-2982-46b8-a3bf-213c46832a71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-ea829e7b-2982-46b8-a3bf-213c46832a71" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-ea829e7b-2982-46b8-a3bf-213c46832a71" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Deleting offline snapshot ea829e7b-2982-46b8-a3bf-213c46832a71 of volume 35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] snapshot_file for this snap is: volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[07949771-9120-4af9-8de5-2b0e406feb93]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:45 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 Sep 07 10:55:45 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:46 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71" returned: 0 in 0.669s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ee6b97-ebcb-46a7-8146-54ec3315451e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:55:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b39e3c-6b1d-4565-979d-1c2acbf4a4f4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:46 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e Sep 07 10:55:46 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:46 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e" returned: 0 in 0.655s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:46 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 Sep 07 10:55:46 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:47 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71" returned: 0 in 0.650s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:47 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71 Sep 07 10:55:47 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:47 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e.ea829e7b-2982-46b8-a3bf-213c46832a71" returned: 0 in 0.537s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-ea829e7b-2982-46b8-a3bf-213c46832a71" released by "_delete_snapshot" :: held 2.719s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" released by "delete_snapshot" :: held 2.789s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Created reservations ['ab5dd32d-47b9-4fa5-97bb-e079ffc89abb', 'b8a870de-7b56-48ce-9384-71328400c7bf', '96b6e881-894e-40be-b45b-b3183891436c', 'ed3acb64-2834-4834-9a04-bafd3defb304'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:55:48 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Delete snapshot completed successfully. Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-ea829e7b-2982-46b8-a3bf-213c46832a71-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Snapshots deleted, issuing volume delete {{(pid=87271) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" acquired by "delete_volume" :: waited 0.044s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d2b81-5ede-4f38-9f4d-eff4fe96e95c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:48 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e Sep 07 10:55:48 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:49 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e" returned: 0 in 0.655s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:49 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e Sep 07 10:55:49 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:49 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-35ee6b97-ebcb-46a7-8146-54ec3315451e" returned: 0 in 0.607s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-35ee6b97-ebcb-46a7-8146-54ec3315451e" released by "delete_volume" :: held 1.413s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:49 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Created reservations ['e4526f07-a71c-4d13-b37f-5edc0a3c1f6f', '4dea029f-f410-400b-9ee2-8e4033d27ddc', 'f14fd057-9132-4a91-8214-e3a9d4e17928', '5ecccdb8-397e-4ab6-b495-1d1aca62dc86'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:50 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:55:50 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:50 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.313s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:55:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Deleted volume successfully. Sep 07 10:55:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-29e82bba-aa98-432a-9f1e-b66b71b14540 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-35ee6b97-ebcb-46a7-8146-54ec3315451e-delete_volume" released by "delete_volume" :: held 7.879s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Flow 'volume_create_manager' (79752eca-c28e-43b1-bf0d-fa700ad5f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a36f617-295a-4a91-8227-c108ddc4ea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Flow 'volume_create_manager' (b11ae5f8-ac05-4a49-9af4-b55c2d26b5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5620c712-ecbd-4241-95c0-8e1f6eec32a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a36f617-295a-4a91-8227-c108ddc4ea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1104893324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c3e93e-1745-4248-9db6-24c83ca6af21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0d8f279ad542729610c848966266d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:53Z,use_quota=True,user_id='5e554620408b485ea2516f40f0b2e6f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ffcc25-56ed-4c69-aae8-dadbc88af52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ffcc25-56ed-4c69-aae8-dadbc88af52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f39a33-2077-4b75-93e5-23daf48363e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f39a33-2077-4b75-93e5-23daf48363e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c3e93e-1745-4248-9db6-24c83ca6af21', 'volume_name': 'volume-38c3e93e-1745-4248-9db6-24c83ca6af21', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4046fe87-f96d-4b8a-a5e3-eae46a27a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4046fe87-f96d-4b8a-a5e3-eae46a27a650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81977c7-28dc-4693-a419-9369aaedcc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Volume 38c3e93e-1745-4248-9db6-24c83ca6af21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c3e93e-1745-4248-9db6-24c83ca6af21', 'volume_size': 1} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1104893324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c3e93e-1745-4248-9db6-24c83ca6af21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0d8f279ad542729610c848966266d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:53Z,use_quota=True,user_id='5e554620408b485ea2516f40f0b2e6f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Creating volume 38c3e93e-1745-4248-9db6-24c83ca6af21 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:53 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5620c712-ecbd-4241-95c0-8e1f6eec32a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1834779671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf1a64c-1381-49de-9444-ea0e56727c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ab3f06a606426898e83fa6e217f914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:53Z,use_quota=True,user_id='4b0df7f7c3aa414fbf9421679bd8bd9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b63c8f0-c409-40c3-9f88-297dab7debe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 1073741824 Sep 07 10:55:53 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b63c8f0-c409-40c3-9f88-297dab7debe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49ff49e-fa8e-4579-8863-c3ef08dcab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49ff49e-fa8e-4579-8863-c3ef08dcab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf1a64c-1381-49de-9444-ea0e56727c11', 'volume_name': 'volume-5bf1a64c-1381-49de-9444-ea0e56727c11', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0689d5f0-5596-4cf8-a0c3-afd0676c21f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0689d5f0-5596-4cf8-a0c3-afd0676c21f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7054d9e0-1848-4753-9395-9d4300814aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:53 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Volume 5bf1a64c-1381-49de-9444-ea0e56727c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf1a64c-1381-49de-9444-ea0e56727c11', 'volume_size': 1} Sep 07 10:55:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:54 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 1073741824" returned: 0 in 1.076s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:54 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 Sep 07 10:55:54 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:55 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21" returned: 0 in 0.519s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1834779671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf1a64c-1381-49de-9444-ea0e56727c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ab3f06a606426898e83fa6e217f914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:53Z,use_quota=True,user_id='4b0df7f7c3aa414fbf9421679bd8bd9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Creating volume 5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:55 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81977c7-28dc-4693-a419-9369aaedcc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c3e93e-1745-4248-9db6-24c83ca6af21', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a302257-5131-4a2e-b9f6-c16d10e9da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:55 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 1073741824 Sep 07 10:55:55 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:55 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Volume volume-38c3e93e-1745-4248-9db6-24c83ca6af21 (38c3e93e-1745-4248-9db6-24c83ca6af21): created successfully Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a302257-5131-4a2e-b9f6-c16d10e9da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Flow 'volume_create_manager' (79752eca-c28e-43b1-bf0d-fa700ad5f187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4e401bbc-413b-425b-802b-531404595f2e tempest-AttachVolumeNegativeTest-942110588 None] Created volume successfully. Sep 07 10:55:56 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 1073741824" returned: 0 in 1.324s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:56 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 Sep 07 10:55:56 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (91e13788-d304-43d1-b35e-2ec69a1b6c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cdb285-3a05-49c3-bb21-7e924b49b407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cdb285-3a05-49c3-bb21-7e924b49b407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419424477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e0d798-2b0d-415b-82d4-0cabbb2d36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:57Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df62edd2-304a-41df-8b33-53044ac5e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df62edd2-304a-41df-8b33-53044ac5e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039413fd-5915-436f-a2ae-6cbfff2a6ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039413fd-5915-436f-a2ae-6cbfff2a6ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e0d798-2b0d-415b-82d4-0cabbb2d36b0', 'volume_name': 'volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828b2dab-a173-487d-a09d-ecba8d63d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828b2dab-a173-487d-a09d-ecba8d63d947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9e9efa-8aab-4b2f-8098-90e3e58c0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Volume 23e0d798-2b0d-415b-82d4-0cabbb2d36b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0', 'volume_size': 1} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:57 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11" returned: 0 in 0.888s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419424477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e0d798-2b0d-415b-82d4-0cabbb2d36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:55:57Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Creating volume 23e0d798-2b0d-415b-82d4-0cabbb2d36b0 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:55:57 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:57 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 1073741824 Sep 07 10:55:57 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7054d9e0-1848-4753-9395-9d4300814aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf1a64c-1381-49de-9444-ea0e56727c11', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6c367a-e233-4f16-b03c-12419fed9e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Volume volume-5bf1a64c-1381-49de-9444-ea0e56727c11 (5bf1a64c-1381-49de-9444-ea0e56727c11): created successfully Sep 07 10:55:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6c367a-e233-4f16-b03c-12419fed9e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Flow 'volume_create_manager' (b11ae5f8-ac05-4a49-9af4-b55c2d26b5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-71df124e-d280-4101-ac51-819c429dcb9b tempest-VolumesDeleteCascade-220706020 None] Created volume successfully. Sep 07 10:55:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-9f1ce3c5-e8e4-4268-968f-34eb6152b2dd req-5a49b08b-c54f-4c76-afb7-0b5d568e4dd8 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:58 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 1073741824" returned: 0 in 0.923s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:55:58 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 Sep 07 10:55:58 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:59 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" returned: 0 in 0.277s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-9f1ce3c5-e8e4-4268-968f-34eb6152b2dd req-5a49b08b-c54f-4c76-afb7-0b5d568e4dd8 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.521s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9e9efa-8aab-4b2f-8098-90e3e58c0b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee2aa4c-49a2-4279-b36d-2d8d65d93e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-9f1ce3c5-e8e4-4268-968f-34eb6152b2dd req-5a49b08b-c54f-4c76-afb7-0b5d568e4dd8 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.308s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:55:59 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Volume volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 (23e0d798-2b0d-415b-82d4-0cabbb2d36b0): created successfully Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee2aa4c-49a2-4279-b36d-2d8d65d93e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (91e13788-d304-43d1-b35e-2ec69a1b6c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Creating offline snapshot 828d438a-a20b-4c13-9fb8-a930b3d86311 of volume 5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:55:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5ed12871-c746-4f0b-862b-8c680950503b tempest-VolumesActionsTest-1646386310 None] Created volume successfully. Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-9f1ce3c5-e8e4-4268-968f-34eb6152b2dd req-5a49b08b-c54f-4c76-afb7-0b5d568e4dd8 tempest-AttachVolumeNegativeTest-942110588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-38c3e93e-1745-4248-9db6-24c83ca6af21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '476e85d7-cea1-405d-807a-346b05cd5500', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16e053f-c951-4794-86f8-c320bc6571b3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-9f1ce3c5-e8e4-4268-968f-34eb6152b2dd req-5a49b08b-c54f-4c76-afb7-0b5d568e4dd8 tempest-AttachVolumeNegativeTest-942110588 None] attachment_update completed successfully. Sep 07 10:55:59 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 Sep 07 10:55:59 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f5557338-bb5f-4aa8-b525-127ad49c100f tempest-VolumesActionsTest-1646386310 None] Acquiring lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" by "attach_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f5557338-bb5f-4aa8-b525-127ad49c100f tempest-VolumesActionsTest-1646386310 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" acquired by "attach_volume" :: waited 0.040s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:55:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f5557338-bb5f-4aa8-b525-127ad49c100f tempest-VolumesActionsTest-1646386310 None] Attaching volume 23e0d798-2b0d-415b-82d4-0cabbb2d36b0 to instance e2bcd681-f00e-42eb-b721-daac26fa8c6a at mountpoint /dev/vdb on host None. Sep 07 10:55:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f5557338-bb5f-4aa8-b525-127ad49c100f tempest-VolumesActionsTest-1646386310 None] Attach volume completed successfully. Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f5557338-bb5f-4aa8-b525-127ad49c100f tempest-VolumesActionsTest-1646386310 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" released by "attach_volume" :: held 0.196s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:55:59 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11" returned: 0 in 0.622s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:55:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:55:59 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 1G Sep 07 10:55:59 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:00 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 1G" returned: 0 in 0.749s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf1a64c-1381-49de-9444-ea0e56727c11 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:00 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf1a64c-1381-49de-9444-ea0e56727c11 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 Sep 07 10:56:00 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-21f05e2a-fdb4-4da7-bfe0-3c9529b3e81b tempest-VolumesActionsTest-1372566655 None] Terminate volume connection completed successfully. Sep 07 10:56:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-21f05e2a-fdb4-4da7-bfe0-3c9529b3e81b tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-detach_volume" by "detach_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-21f05e2a-fdb4-4da7-bfe0-3c9529b3e81b tempest-VolumesActionsTest-1372566655 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-21f05e2a-fdb4-4da7-bfe0-3c9529b3e81b tempest-VolumesActionsTest-1372566655 None] Detaching volume 23e0d798-2b0d-415b-82d4-0cabbb2d36b0 from instance e2bcd681-f00e-42eb-b721-daac26fa8c6a. Sep 07 10:56:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-21f05e2a-fdb4-4da7-bfe0-3c9529b3e81b tempest-VolumesActionsTest-1372566655 None] Detach volume completed successfully. Sep 07 10:56:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-21f05e2a-fdb4-4da7-bfe0-3c9529b3e81b tempest-VolumesActionsTest-1372566655 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:01 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ff5a65d8-aa50-46dd-a076-3134b3c9a06b tempest-VolumesActionsTest-1646386310 None] Acquiring lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-detach_volume" by "detach_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf1a64c-1381-49de-9444-ea0e56727c11 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311" returned: 0 in 0.724s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:01 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 is being set with open permissions: ugo+rw Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ff5a65d8-aa50-46dd-a076-3134b3c9a06b tempest-VolumesActionsTest-1646386310 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ff5a65d8-aa50-46dd-a076-3134b3c9a06b tempest-VolumesActionsTest-1646386310 None] Volume detach called, but volume not attached. Sep 07 10:56:01 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 Sep 07 10:56:01 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ff5a65d8-aa50-46dd-a076-3134b3c9a06b tempest-VolumesActionsTest-1646386310 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:01 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311" returned: 0 in 0.520s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "cinder-quobyte-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:01 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.info Sep 07 10:56:01 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Lock "cinder-quobyte-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:02 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5928ee22-fedd-4b90-ac85-f7da8f24a9e0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:02 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 Sep 07 10:56:02 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:02 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.info" returned: 0 in 0.664s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:02 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.info is being set with open permissions: ugo+rw Sep 07 10:56:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:02 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.info Sep 07 10:56:02 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:02 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" returned: 0 in 0.651s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:02 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0 Sep 07 10:56:02 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:03 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.info" returned: 0 in 0.502s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:03 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.035s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" returned: 0 in 0.444s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Lock "cinder-quobyte-23e0d798-2b0d-415b-82d4-0cabbb2d36b0" released by "delete_volume" :: held 1.163s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-461bc95e-e1f4-444d-9f1b-a9aef4bafc89 tempest-VolumesDeleteCascade-220706020 None] Create snapshot completed successfully Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Created reservations ['63f87fa8-51c6-4722-ba7c-ac40387679e9', 'c68a4889-3b38-4d17-a721-b6cfb16ba806', '3d5ac2fa-a401-4ebe-ac5c-31376a67d92a', '6cb9cd8f-a26a-4185-b2fe-acf35274d2a2'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=77,cinder:SELECT=69,cinder:DELETE=4,cinder:INSERT=20 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:03 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:03 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:03 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.263s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Deleted volume successfully. Sep 07 10:56:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-202a7205-fb45-4d15-82c4-6fc76752e6a0 tempest-VolumesActionsTest-1646386310 None] Lock "cinder-23e0d798-2b0d-415b-82d4-0cabbb2d36b0-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:04 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=87,cinder:INSERT=21,cinder:UPDATE=66,cinder:DELETE=9 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Flow 'volume_create_manager' (390a9c73-c068-4963-b565-9e04c5f4ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3650a922-1033-4c4d-8088-22858c271872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3650a922-1033-4c4d-8088-22858c271872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1975727096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76837eb8-75ab-4fcd-a74a-dcca039d3d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ab3f06a606426898e83fa6e217f914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=828d438a-a20b-4c13-9fb8-a930b3d86311,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:05Z,use_quota=True,user_id='4b0df7f7c3aa414fbf9421679bd8bd9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81307db8-5189-4e93-bbf2-b489dddb15eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81307db8-5189-4e93-bbf2-b489dddb15eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6079aa13-2bc0-4184-a89a-9f2fa1177700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6079aa13-2bc0-4184-a89a-9f2fa1177700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76837eb8-75ab-4fcd-a74a-dcca039d3d60', 'volume_name': 'volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60', 'volume_size': 1, 'snapshot_id': '828d438a-a20b-4c13-9fb8-a930b3d86311'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe775835-b9b3-40ee-bdb5-e6bfde832d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe775835-b9b3-40ee-bdb5-e6bfde832d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd12471f-fe5b-49b1-baee-c69daf393580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Volume 76837eb8-75ab-4fcd-a74a-dcca039d3d60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60', 'volume_size': 1, 'snapshot_id': '828d438a-a20b-4c13-9fb8-a930b3d86311'} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-828d438a-a20b-4c13-9fb8-a930b3d86311-76837eb8-75ab-4fcd-a74a-dcca039d3d60" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-828d438a-a20b-4c13-9fb8-a930b3d86311-76837eb8-75ab-4fcd-a74a-dcca039d3d60" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Creating volume 76837eb8-75ab-4fcd-a74a-dcca039d3d60 from snapshot 828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-76837eb8-75ab-4fcd-a74a-dcca039d3d60" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-76837eb8-75ab-4fcd-a74a-dcca039d3d60" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] snapshot: 828d438a-a20b-4c13-9fb8-a930b3d86311, volume: 76837eb8-75ab-4fcd-a74a-dcca039d3d60, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e4bfd-d115-4857-b3ab-7b91cb7d5ec8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:05 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 Sep 07 10:56:05 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:06 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311" returned: 0 in 0.602s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bf1a64c-1381-49de-9444-ea0e56727c11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2eeb04-b4ed-44ff-a7d0-3545ca4a59d1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:06 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 Sep 07 10:56:06 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:06 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11" returned: 0 in 0.560s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:56:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:06 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 Sep 07 10:56:06 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (00c17502-b24b-4c46-8017-cad589aa8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8dffd7-2779-4c0f-9cd3-6b2a2477c8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8dffd7-2779-4c0f-9cd3-6b2a2477c8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765845722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524b15f6-980f-4255-8e65-09d92215749c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:09Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cffe495-84c3-4976-afea-9b1dbad93713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cffe495-84c3-4976-afea-9b1dbad93713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0215ae-67e6-4ca8-aac9-340e50367e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0215ae-67e6-4ca8-aac9-340e50367e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524b15f6-980f-4255-8e65-09d92215749c', 'volume_name': 'volume-524b15f6-980f-4255-8e65-09d92215749c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5081789d-b8a4-4490-b0dc-fdc89f3b459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5081789d-b8a4-4490-b0dc-fdc89f3b459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8734122b-42cd-4961-892c-f0dfec4945cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:09 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Volume 524b15f6-980f-4255-8e65-09d92215749c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524b15f6-980f-4255-8e65-09d92215749c', 'volume_size': 1} Sep 07 10:56:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:56:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:10 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:10 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:11 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 1.008s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:56:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:56:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:56:13 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60" returned: 0 in 7.007s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:13 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:56:13 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Converted 1024.00 MB image at 146.13 MB/s Sep 07 10:56:13 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 is being set with open permissions: ugo+rw Sep 07 10:56:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:13 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 Sep 07 10:56:13 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:13 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60" returned: 0 in 0.339s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-76837eb8-75ab-4fcd-a74a-dcca039d3d60" released by "_copy_volume_from_snapshot" :: held 8.695s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-828d438a-a20b-4c13-9fb8-a930b3d86311-76837eb8-75ab-4fcd-a74a-dcca039d3d60" released by "_create_volume_from_snapshot" :: held 8.802s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.823s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765845722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524b15f6-980f-4255-8e65-09d92215749c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:09Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Creating volume 524b15f6-980f-4255-8e65-09d92215749c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:14 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:14 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c 1073741824 Sep 07 10:56:14 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd12471f-fe5b-49b1-baee-c69daf393580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60', 'volume_size': 1, 'snapshot_id': '828d438a-a20b-4c13-9fb8-a930b3d86311'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9796b66-d0a9-4ac9-b4c6-cbf146db44e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:14 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Volume volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 (76837eb8-75ab-4fcd-a74a-dcca039d3d60): created successfully Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9796b66-d0a9-4ac9-b4c6-cbf146db44e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Flow 'volume_create_manager' (390a9c73-c068-4963-b565-9e04c5f4ef46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-83ba9ce6-c071-4bed-8b1f-47f1b617134d tempest-VolumesDeleteCascade-220706020 None] Created volume successfully. Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-5bf1a64c-1381-49de-9444-ea0e56727c11-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-5bf1a64c-1381-49de-9444-ea0e56727c11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Performing cascade delete. {{(pid=87271) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-828d438a-a20b-4c13-9fb8-a930b3d86311-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-828d438a-a20b-4c13-9fb8-a930b3d86311-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-5bf1a64c-1381-49de-9444-ea0e56727c11" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:14 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c 1073741824" returned: 0 in 0.595s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-5bf1a64c-1381-49de-9444-ea0e56727c11" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-828d438a-a20b-4c13-9fb8-a930b3d86311" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-828d438a-a20b-4c13-9fb8-a930b3d86311" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Deleting offline snapshot 828d438a-a20b-4c13-9fb8-a930b3d86311 of volume 5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] snapshot_file for this snap is: volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4190960-bef2-45d2-892a-2928129e3ed6]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:14 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c Sep 07 10:56:14 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:14 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 Sep 07 10:56:14 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:15 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c" returned: 0 in 0.443s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8734122b-42cd-4961-892c-f0dfec4945cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524b15f6-980f-4255-8e65-09d92215749c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249b8bec-c9da-4232-bc43-84244d425d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:15 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Volume volume-524b15f6-980f-4255-8e65-09d92215749c (524b15f6-980f-4255-8e65-09d92215749c): created successfully Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249b8bec-c9da-4232-bc43-84244d425d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (00c17502-b24b-4c46-8017-cad589aa8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b4ed4e44-7eac-4a17-b0d3-1defc6034318 tempest-VolumesActionsTest-1646386310 None] Created volume successfully. Sep 07 10:56:15 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311" returned: 0 in 0.591s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bf1a64c-1381-49de-9444-ea0e56727c11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac458cd-83ba-446e-a3b4-be6c490bb1e0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-d8d4551f-385c-463f-a5b7-94fa58a770b2 req-1de77435-9cc9-48a7-b963-ea600b445d68 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-d8d4551f-385c-463f-a5b7-94fa58a770b2 req-1de77435-9cc9-48a7-b963-ea600b445d68 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-d8d4551f-385c-463f-a5b7-94fa58a770b2 req-1de77435-9cc9-48a7-b963-ea600b445d68 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.071s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-d8d4551f-385c-463f-a5b7-94fa58a770b2 req-1de77435-9cc9-48a7-b963-ea600b445d68 tempest-TestInstancesWithCinderVolumes-220368711 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-1925c6d7-1dba-462b-9adf-ec1864955f50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '643cb2a3-e196-4a47-a4e9-bed2db57f991', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:56:15 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 Sep 07 10:56:15 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-d8d4551f-385c-463f-a5b7-94fa58a770b2 req-1de77435-9cc9-48a7-b963-ea600b445d68 tempest-TestInstancesWithCinderVolumes-220368711 None] attachment_update completed successfully. Sep 07 10:56:16 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11" returned: 0 in 1.103s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:16 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 Sep 07 10:56:16 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-524b15f6-980f-4255-8e65-09d92215749c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-524b15f6-980f-4255-8e65-09d92215749c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-quobyte-524b15f6-980f-4255-8e65-09d92215749c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-524b15f6-980f-4255-8e65-09d92215749c" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc04b20-b213-4296-bd41-6a143a539e58]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:17 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c Sep 07 10:56:17 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:17 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311" returned: 0 in 0.712s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:17 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311 Sep 07 10:56:17 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:17 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c" returned: 0 in 0.525s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:17 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c Sep 07 10:56:17 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:17 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11.828d438a-a20b-4c13-9fb8-a930b3d86311" returned: 0 in 0.356s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-828d438a-a20b-4c13-9fb8-a930b3d86311" released by "_delete_snapshot" :: held 2.912s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-5bf1a64c-1381-49de-9444-ea0e56727c11" released by "delete_snapshot" :: held 2.954s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Created reservations ['cc388ec4-4d94-4a6c-89ad-c475dab70d99', 'f39eaffc-8267-4955-b409-18223f4d6a52', '425710bf-c87e-4460-a396-ddda1b447305', '2d3a51e4-2fb3-4e1b-a994-1446822d5746'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:17 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-524b15f6-980f-4255-8e65-09d92215749c" returned: 0 in 0.449s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-524b15f6-980f-4255-8e65-09d92215749c" released by "delete_volume" :: held 1.063s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Delete snapshot completed successfully. Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-828d438a-a20b-4c13-9fb8-a930b3d86311-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Snapshots deleted, issuing volume delete {{(pid=87271) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-5bf1a64c-1381-49de-9444-ea0e56727c11" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-5bf1a64c-1381-49de-9444-ea0e56727c11" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Created reservations ['9a98ecae-d0b2-4b85-8df2-860ceb03e7a9', '4f233b0f-fe20-4270-9864-709d57a92785', 'ef6edbc7-f725-42b5-a38b-3379d952e5f8', '0f8f3399-80eb-4aa6-8afb-23dd9f68c2a4'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[95870b51-2e90-4ca6-9e1d-ba8b17d1c938]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:18 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 Sep 07 10:56:18 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:18 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:18 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:18 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.374s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Deleted volume successfully. Sep 07 10:56:18 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11" returned: 0 in 0.632s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-60a43f18-34f7-4112-bbc1-5f3138951386 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-524b15f6-980f-4255-8e65-09d92215749c-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:18 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11 Sep 07 10:56:18 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:19 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-5bf1a64c-1381-49de-9444-ea0e56727c11" returned: 0 in 0.453s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-5bf1a64c-1381-49de-9444-ea0e56727c11" released by "delete_volume" :: held 1.207s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-e3a0556f-ab42-4292-a92b-f25bb6532a17 req-b6efe1bf-924b-4800-ad0f-d186f11dad02 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-e3a0556f-ab42-4292-a92b-f25bb6532a17 req-b6efe1bf-924b-4800-ad0f-d186f11dad02 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-e3a0556f-ab42-4292-a92b-f25bb6532a17 req-b6efe1bf-924b-4800-ad0f-d186f11dad02 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Created reservations ['23d7a300-5742-4901-a01c-f763150a5e94', '69418003-f657-41aa-8114-664990b13a13', 'a488f8a6-318c-4363-b894-a2114281671c', 'e492b685-48a7-4f49-859c-052e06717423'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-e3a0556f-ab42-4292-a92b-f25bb6532a17 req-b6efe1bf-924b-4800-ad0f-d186f11dad02 tempest-TestInstancesWithCinderVolumes-220368711 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-1f154557-d203-41a9-b14f-db56dc4168a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42268a24-56d5-4016-bf73-3de35d518d87', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:56:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-e3a0556f-ab42-4292-a92b-f25bb6532a17 req-b6efe1bf-924b-4800-ad0f-d186f11dad02 tempest-TestInstancesWithCinderVolumes-220368711 None] attachment_update completed successfully. Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:19 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:19 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (adf5e4c6-77d8-44d0-ab0d-1782a595006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526ed14c-e02f-4827-b796-557588612ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526ed14c-e02f-4827-b796-557588612ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526196392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7cd585-a3dd-4e14-9a46-512889bdd922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:20Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2e5fd9-6c9c-4ae1-ac3a-16c2615735c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2e5fd9-6c9c-4ae1-ac3a-16c2615735c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739c224e-ea49-4699-90ea-c44e5aa6f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739c224e-ea49-4699-90ea-c44e5aa6f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7cd585-a3dd-4e14-9a46-512889bdd922', 'volume_name': 'volume-db7cd585-a3dd-4e14-9a46-512889bdd922', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0508fe69-8518-4e12-9a4b-3a2057833821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0508fe69-8518-4e12-9a4b-3a2057833821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72deccbe-256b-4843-a9a0-92bcc825790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Volume db7cd585-a3dd-4e14-9a46-512889bdd922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7cd585-a3dd-4e14-9a46-512889bdd922', 'volume_size': 1} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526196392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7cd585-a3dd-4e14-9a46-512889bdd922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:20Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Creating volume db7cd585-a3dd-4e14-9a46-512889bdd922 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:19 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:56:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:20 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.527s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:20 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 1073741824 Sep 07 10:56:20 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Deleted volume successfully. Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c564b1f7-d138-4722-bf01-1112dc7548af tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-5bf1a64c-1381-49de-9444-ea0e56727c11-delete_volume" released by "delete_volume" :: held 5.554s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-76837eb8-75ab-4fcd-a74a-dcca039d3d60-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-76837eb8-75ab-4fcd-a74a-dcca039d3d60-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "cinder-quobyte-76837eb8-75ab-4fcd-a74a-dcca039d3d60" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-76837eb8-75ab-4fcd-a74a-dcca039d3d60" acquired by "delete_volume" :: waited 0.048s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[55722641-aa32-42a8-891d-cde5d9e21a76]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:20 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 1073741824" returned: 0 in 0.822s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:20 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 Sep 07 10:56:20 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:20 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 Sep 07 10:56:20 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:21 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922" returned: 0 in 0.430s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72deccbe-256b-4843-a9a0-92bcc825790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7cd585-a3dd-4e14-9a46-512889bdd922', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b0e794-6027-4fa1-b500-a54cf796f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:21 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60" returned: 0 in 0.565s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Volume volume-db7cd585-a3dd-4e14-9a46-512889bdd922 (db7cd585-a3dd-4e14-9a46-512889bdd922): created successfully Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b0e794-6027-4fa1-b500-a54cf796f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:21 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60 Sep 07 10:56:21 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (adf5e4c6-77d8-44d0-ab0d-1782a595006b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a7d42a5f-8dfa-48f7-b0c8-10769f15f5b4 tempest-VolumesActionsTest-1646386310 None] Created volume successfully. Sep 07 10:56:21 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-76837eb8-75ab-4fcd-a74a-dcca039d3d60" returned: 0 in 0.322s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-quobyte-76837eb8-75ab-4fcd-a74a-dcca039d3d60" released by "delete_volume" :: held 0.950s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Created reservations ['101e254d-4deb-4beb-85fd-4a3e229129a0', '7868593d-6b3e-448f-aea0-b1ab12c8ab8e', '9edc3d6f-d65a-4041-8e1c-0eaa7fe70393', 'b4ab8e58-5f5a-4442-88f3-7df7d4f66cea'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:21 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:21 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-db7cd585-a3dd-4e14-9a46-512889bdd922-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Lock "cinder-db7cd585-a3dd-4e14-9a46-512889bdd922-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-quobyte-db7cd585-a3dd-4e14-9a46-512889bdd922" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-db7cd585-a3dd-4e14-9a46-512889bdd922" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa89a1b-cb4f-4b31-8a32-c6cb722e43f5]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:22 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.542s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Deleted volume successfully. Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02cf9de6-962b-4e4f-b25c-277940895be5 tempest-VolumesDeleteCascade-220706020 None] Lock "cinder-76837eb8-75ab-4fcd-a74a-dcca039d3d60-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:22 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 Sep 07 10:56:22 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:22 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922" returned: 0 in 0.538s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:22 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922 Sep 07 10:56:22 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:23 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db7cd585-a3dd-4e14-9a46-512889bdd922" returned: 0 in 0.311s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-db7cd585-a3dd-4e14-9a46-512889bdd922" released by "delete_volume" :: held 0.907s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Created reservations ['fd409c38-51bc-4308-82f3-7dca2b934793', '14b71045-cd32-420e-a68d-0947644fbcba', 'ea8774ef-d079-42f6-a0f5-c2b7ade7e345', '8da59cc7-a30c-45a5-ac45-a3b78cfd92f3'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:23 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:23 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:23 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.367s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:23 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Deleted volume successfully. Sep 07 10:56:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-34ddafcb-36de-46bc-b5b5-b56361f49cfb tempest-VolumesActionsTest-1372566655 None] Lock "cinder-db7cd585-a3dd-4e14-9a46-512889bdd922-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (9dc507c4-e724-4b57-861b-f633be11016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28faa817-4055-4492-a02a-bd7e18be6236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28faa817-4055-4492-a02a-bd7e18be6236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-110141122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c786a7dd-9b72-4119-a60f-f7ab9c6b1b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:25Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61cb0aa-d37a-482d-b208-265469d27cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61cb0aa-d37a-482d-b208-265469d27cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca7ccc0-c8b3-4143-b63a-3dc4e971a258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca7ccc0-c8b3-4143-b63a-3dc4e971a258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c786a7dd-9b72-4119-a60f-f7ab9c6b1b27', 'volume_name': 'volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da3165c-a76c-47d4-b86a-331849c914fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da3165c-a76c-47d4-b86a-331849c914fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ba7e56-dfe9-427d-bd07-f2706ef09b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Volume c786a7dd-9b72-4119-a60f-f7ab9c6b1b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27', 'volume_size': 1} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-110141122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c786a7dd-9b72-4119-a60f-f7ab9c6b1b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:25Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Creating volume c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:56:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:24 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 1073741824 Sep 07 10:56:24 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:25 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 1073741824" returned: 0 in 0.620s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:25 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 Sep 07 10:56:25 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:25 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27" returned: 0 in 0.331s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ba7e56-dfe9-427d-bd07-f2706ef09b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d4bbfa-39bc-4dde-bd28-83e7d2aecd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Volume volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 (c786a7dd-9b72-4119-a60f-f7ab9c6b1b27): created successfully Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d4bbfa-39bc-4dde-bd28-83e7d2aecd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (9dc507c4-e724-4b57-861b-f633be11016c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-53b3b8c2-4d06-4fd5-85c6-95a16fcfe21e tempest-VolumesActionsTest-1646386310 None] Created volume successfully. Sep 07 10:56:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-ce7d3f54-6ce2-4a63-b085-e221ca014d7f req-dacc2816-2034-439d-806a-3f70bcdcde85 tempest-TestInstancesWithCinderVolumes-220368711 None] Terminate volume connection completed successfully. Sep 07 10:56:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-ce7d3f54-6ce2-4a63-b085-e221ca014d7f req-dacc2816-2034-439d-806a-3f70bcdcde85 tempest-TestInstancesWithCinderVolumes-220368711 None] Deleting attachment 643cb2a3-e196-4a47-a4e9-bed2db57f991. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:56:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-quobyte-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[0342090e-7fab-4dc6-9ece-8d19d4507161]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:27 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 Sep 07 10:56:27 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "cinder-1925c6d7-1dba-462b-9adf-ec1864955f50-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-1925c6d7-1dba-462b-9adf-ec1864955f50-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "cinder-quobyte-1925c6d7-1dba-462b-9adf-ec1864955f50" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-quobyte-1925c6d7-1dba-462b-9adf-ec1864955f50" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1abd2-74ab-4314-af1d-2727056fdf69]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:27 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27" returned: 0 in 0.577s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:27 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27 Sep 07 10:56:27 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:27 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 Sep 07 10:56:27 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:28 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27" returned: 0 in 0.489s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27" released by "delete_volume" :: held 1.135s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:28 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50" returned: 0 in 0.644s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:28 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50 Sep 07 10:56:28 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Created reservations ['c67ee4d1-f629-4d8a-96ff-4d93a1ad6f1a', 'e76bce97-0449-48d0-bf73-f9f3af1fee33', '3e7c4025-6def-4933-8f9d-09d6c1b0ccff', 'eba9b80c-a9af-4eba-a41e-b4eecaacb2e4'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:28 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:28 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:28 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1925c6d7-1dba-462b-9adf-ec1864955f50" returned: 0 in 0.397s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-quobyte-1925c6d7-1dba-462b-9adf-ec1864955f50" released by "delete_volume" :: held 1.118s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:28 devstack cinder-volume[87271]: WARNING cinder.quota [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731067236-899648745 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731067236-899648745, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:56:28 devstack cinder-volume[87271]: WARNING cinder.quota [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731067236-899648745 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731067236-899648745, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:56:28 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Deleted volume successfully. Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Created reservations ['47bd61ff-540e-44e4-827a-b45f05b10e8c', '2da93813-bf53-4604-b0e3-4305b4041788', '7145d759-ba69-4fd2-89ad-69895edcd679', 'c0d65520-ccd9-4794-bfc9-9dc729c4b094'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87c6da61-db4a-4adb-b7e6-b2bf63cb9b71 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-c786a7dd-9b72-4119-a60f-f7ab9c6b1b27-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:28 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:28 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:29 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.394s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:29 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:29 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Deleted volume successfully. Sep 07 10:56:29 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4d58be65-4211-4bc6-84e2-c00055f4845b tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-1925c6d7-1dba-462b-9adf-ec1864955f50-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (72b04a2e-c41f-4a37-b8eb-12f13da70efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d238b2f-93d5-45ef-834a-d87409c9f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d238b2f-93d5-45ef-834a-d87409c9f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-351447028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbe7812-4bda-4e5a-977d-ae46cdb58a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:30Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cff643b-642e-4a85-9cef-d3dafb6c4de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cff643b-642e-4a85-9cef-d3dafb6c4de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02a729f-32d1-4a3b-bbac-b42814165a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02a729f-32d1-4a3b-bbac-b42814165a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdbe7812-4bda-4e5a-977d-ae46cdb58a63', 'volume_name': 'volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474cde5f-8c66-4e2a-a418-2c3c5488ce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474cde5f-8c66-4e2a-a418-2c3c5488ce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b1adf3-b161-43a5-a46a-b152d32ec55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:30 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Volume fdbe7812-4bda-4e5a-977d-ae46cdb58a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63', 'volume_size': 1} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-351447028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbe7812-4bda-4e5a-977d-ae46cdb58a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:30Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Creating volume fdbe7812-4bda-4e5a-977d-ae46cdb58a63 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:30 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:56:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:30 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 1073741824 Sep 07 10:56:30 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:31 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 1073741824" returned: 0 in 0.828s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Flow 'volume_create_manager' (38f224c9-41f1-4be3-bb27-24554952faf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02034a2d-4124-475b-9096-30073f6b362c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02034a2d-4124-475b-9096-30073f6b362c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1039998184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca941961-4921-4944-82a1-a76a6d45b2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee335734dd74271a277e1db869c0a0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:31Z,use_quota=True,user_id='f05fbe3f0d9b470abba649df9b609e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:31 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 Sep 07 10:56:31 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177da039-d639-4aeb-a35b-aa66dfe4370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177da039-d639-4aeb-a35b-aa66dfe4370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db984ec-1894-4728-9fde-50f8c9fab81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db984ec-1894-4728-9fde-50f8c9fab81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca941961-4921-4944-82a1-a76a6d45b2fe', 'volume_name': 'volume-ca941961-4921-4944-82a1-a76a6d45b2fe', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82657a21-1da6-44c8-9127-2edb49d402c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82657a21-1da6-44c8-9127-2edb49d402c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10d1a91-15cf-4fd5-b443-3c8cca8eafd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Volume ca941961-4921-4944-82a1-a76a6d45b2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca941961-4921-4944-82a1-a76a6d45b2fe', 'volume_size': 1} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:31 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1039998184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca941961-4921-4944-82a1-a76a6d45b2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee335734dd74271a277e1db869c0a0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:31Z,use_quota=True,user_id='f05fbe3f0d9b470abba649df9b609e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Creating volume ca941961-4921-4944-82a1-a76a6d45b2fe {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:31 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:31 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe 1073741824 Sep 07 10:56:31 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b1adf3-b161-43a5-a46a-b152d32ec55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf6a733-18df-4843-a3d7-59abb995acd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Volume volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 (fdbe7812-4bda-4e5a-977d-ae46cdb58a63): created successfully Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf6a733-18df-4843-a3d7-59abb995acd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (72b04a2e-c41f-4a37-b8eb-12f13da70efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e8fdb4d8-2a3e-4698-b8d8-fead44387cbf tempest-VolumesActionsTest-1646386310 None] Created volume successfully. Sep 07 10:56:32 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe 1073741824" returned: 0 in 0.493s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:32 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe Sep 07 10:56:32 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-fdbe7812-4bda-4e5a-977d-ae46cdb58a63-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:32 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe" returned: 0 in 0.307s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10d1a91-15cf-4fd5-b443-3c8cca8eafd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca941961-4921-4944-82a1-a76a6d45b2fe', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11778b6d-3de7-488a-8310-6e3d1908b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-fdbe7812-4bda-4e5a-977d-ae46cdb58a63-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-1e02f8db-4d3c-48a0-9c0d-cea5638ddc69 req-1710a3d7-0793-4469-9074-d6e4dfe79f25 tempest-TestInstancesWithCinderVolumes-220368711 None] Terminate volume connection completed successfully. Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-1e02f8db-4d3c-48a0-9c0d-cea5638ddc69 req-1710a3d7-0793-4469-9074-d6e4dfe79f25 tempest-TestInstancesWithCinderVolumes-220368711 None] Deleting attachment 42268a24-56d5-4016-bf73-3de35d518d87. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:56:32 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Volume volume-ca941961-4921-4944-82a1-a76a6d45b2fe (ca941961-4921-4944-82a1-a76a6d45b2fe): created successfully Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11778b6d-3de7-488a-8310-6e3d1908b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Flow 'volume_create_manager' (38f224c9-41f1-4be3-bb27-24554952faf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-be02dbf9-0382-4a89-a7af-e9f70d766212 tempest-VolumesTransfersTest-987306125 None] Created volume successfully. Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "cinder-quobyte-fdbe7812-4bda-4e5a-977d-ae46cdb58a63" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-fdbe7812-4bda-4e5a-977d-ae46cdb58a63" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cdd2c7-0e40-4944-9878-75219527422f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:32 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 Sep 07 10:56:32 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:32 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63" returned: 0 in 0.362s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:32 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63 Sep 07 10:56:32 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "cinder-1f154557-d203-41a9-b14f-db56dc4168a4-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-1f154557-d203-41a9-b14f-db56dc4168a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:33 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fdbe7812-4bda-4e5a-977d-ae46cdb58a63" returned: 0 in 0.280s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-quobyte-fdbe7812-4bda-4e5a-977d-ae46cdb58a63" released by "delete_volume" :: held 0.686s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "cinder-quobyte-1f154557-d203-41a9-b14f-db56dc4168a4" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-quobyte-1f154557-d203-41a9-b14f-db56dc4168a4" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d6c8e7-a5fb-44ac-8ae4-cf72a1f2fbfd]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Created reservations ['c8585355-146e-4a4d-8fff-f6a750f94dab', '0142fb1e-eb3d-4a34-94c4-fd6ed9f4ab05', 'ca44f96b-7cf8-4892-8bd1-8c2b22acbab8', 'f8c64d48-ee91-468f-a67a-131445d92722'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:33 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 Sep 07 10:56:33 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:33 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:33 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:33 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.395s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Deleted volume successfully. Sep 07 10:56:33 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4" returned: 0 in 0.594s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1335f5f-e979-4a2d-abfc-161d273d4580 tempest-VolumesActionsTest-1372566655 None] Lock "cinder-fdbe7812-4bda-4e5a-977d-ae46cdb58a63-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:33 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4 Sep 07 10:56:33 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:34 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f154557-d203-41a9-b14f-db56dc4168a4" returned: 0 in 0.337s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-quobyte-1f154557-d203-41a9-b14f-db56dc4168a4" released by "delete_volume" :: held 0.999s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:34 devstack cinder-volume[87271]: WARNING cinder.quota [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70050702-369223181 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70050702-369223181, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:56:34 devstack cinder-volume[87271]: WARNING cinder.quota [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70050702-369223181 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70050702-369223181, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Created reservations ['9138ecb1-d4a6-4133-9f51-c13fa66628d8', 'f7e1336b-977f-4ec1-950a-76ce59ca059e', '5bd65b08-f09f-444f-9d0b-72c947f1d5b2', '34f7b6b0-74fb-4232-af7b-7b93314dc1bd'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (1e4037e0-c22a-4c33-ab9c-c1e7ab7b9190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a421190-4243-49fb-905a-7f73164389e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a421190-4243-49fb-905a-7f73164389e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202900387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bbb587-8483-400e-83db-fc228af87b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:34Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41f27e7-b345-4ba4-9a57-2030457f757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41f27e7-b345-4ba4-9a57-2030457f757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c8f326-3ab5-4517-b933-eea2fdbb064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c8f326-3ab5-4517-b933-eea2fdbb064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bbb587-8483-400e-83db-fc228af87b45', 'volume_name': 'volume-07bbb587-8483-400e-83db-fc228af87b45', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9be249-5b4d-4fe5-b799-00c033815817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9be249-5b4d-4fe5-b799-00c033815817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc318b0-c5fa-498a-92d3-ab159511bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:34 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Volume 07bbb587-8483-400e-83db-fc228af87b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bbb587-8483-400e-83db-fc228af87b45', 'volume_size': 1} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202900387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bbb587-8483-400e-83db-fc228af87b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115c35c329cc4fcc9cca0ef0198d7b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:34Z,use_quota=True,user_id='7944f7b6b4114942ae182f2ee5dadd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Creating volume 07bbb587-8483-400e-83db-fc228af87b45 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:34 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:34 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 1073741824 Sep 07 10:56:34 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-24dab2b8-592f-4349-97f6-478ff4bd2e98 tempest-VolumesTransfersTest-1635587843 None] Transfer volume completed successfully. Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:34 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:34 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:35 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.398s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Deleted volume successfully. Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-66f131aa-4691-4083-b10f-33f8f829aebc tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-1f154557-d203-41a9-b14f-db56dc4168a4-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:35 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 1073741824" returned: 0 in 0.614s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:35 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 Sep 07 10:56:35 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Acquiring lock "cinder-ca941961-4921-4944-82a1-a76a6d45b2fe-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Lock "cinder-ca941961-4921-4944-82a1-a76a6d45b2fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Acquiring lock "cinder-quobyte-ca941961-4921-4944-82a1-a76a6d45b2fe" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Lock "cinder-quobyte-ca941961-4921-4944-82a1-a76a6d45b2fe" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:35 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bdd114-7b09-4a86-8bc5-cdfb7bd6e02e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45" returned: 0 in 0.385s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc318b0-c5fa-498a-92d3-ab159511bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bbb587-8483-400e-83db-fc228af87b45', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be06710b-5b01-4cfa-8697-f07e9c3ebd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Volume volume-07bbb587-8483-400e-83db-fc228af87b45 (07bbb587-8483-400e-83db-fc228af87b45): created successfully Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be06710b-5b01-4cfa-8697-f07e9c3ebd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Flow 'volume_create_manager' (1e4037e0-c22a-4c33-ab9c-c1e7ab7b9190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a08683d9-2fe8-4e98-ab6b-59f17103c128 tempest-VolumesActionsTest-1646386310 None] Created volume successfully. Sep 07 10:56:35 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe Sep 07 10:56:35 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:35 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe" returned: 0 in 0.373s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:35 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe Sep 07 10:56:35 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:36 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca941961-4921-4944-82a1-a76a6d45b2fe" returned: 0 in 0.301s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Lock "cinder-quobyte-ca941961-4921-4944-82a1-a76a6d45b2fe" released by "delete_volume" :: held 0.720s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Created reservations ['e0ba19f0-f28d-40a1-a575-dd98a45c45b5', '220f5133-26c0-4ece-af51-0647971a22f5', '00723933-016e-4617-82ed-67cf926e719c', '4b84499a-ebf2-4d8e-b2dc-a3df20da8482'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:36 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:36 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:37 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.547s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Deleted volume successfully. Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-79cd7fcb-1408-45a1-9b62-f1e7b2118a9f tempest-VolumesTransfersTest-879023635 None] Lock "cinder-ca941961-4921-4944-82a1-a76a6d45b2fe-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Acquiring lock "cinder-07bbb587-8483-400e-83db-fc228af87b45-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Lock "cinder-07bbb587-8483-400e-83db-fc228af87b45-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Acquiring lock "cinder-quobyte-07bbb587-8483-400e-83db-fc228af87b45" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Lock "cinder-quobyte-07bbb587-8483-400e-83db-fc228af87b45" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[009b0119-e686-4049-9796-b308d6d550f2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Flow 'volume_create_manager' (3c3f5eca-3d0e-46e4-acab-a632d9bf5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619b2b52-2a4c-45c5-a826-90c8dcb2fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619b2b52-2a4c-45c5-a826-90c8dcb2fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-341103425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c31c37-38b7-4705-86fd-7ec26ded5096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee335734dd74271a277e1db869c0a0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:38Z,use_quota=True,user_id='f05fbe3f0d9b470abba649df9b609e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fe38e7-6a05-42e4-bac5-48988f5b7146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:37 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 Sep 07 10:56:37 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fe38e7-6a05-42e4-bac5-48988f5b7146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa74762e-727d-49c0-af19-a096108a8746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa74762e-727d-49c0-af19-a096108a8746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c31c37-38b7-4705-86fd-7ec26ded5096', 'volume_name': 'volume-60c31c37-38b7-4705-86fd-7ec26ded5096', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7071fbff-cbc7-404b-96b8-f33e760fbdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7071fbff-cbc7-404b-96b8-f33e760fbdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961c461a-d498-43ec-a1aa-111fa7d07be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Volume 60c31c37-38b7-4705-86fd-7ec26ded5096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c31c37-38b7-4705-86fd-7ec26ded5096', 'volume_size': 1} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-341103425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c31c37-38b7-4705-86fd-7ec26ded5096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee335734dd74271a277e1db869c0a0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:56:38Z,use_quota=True,user_id='f05fbe3f0d9b470abba649df9b609e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Creating volume 60c31c37-38b7-4705-86fd-7ec26ded5096 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:56:37 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:56:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:37 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 1073741824 Sep 07 10:56:37 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:38 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45" returned: 0 in 0.733s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-c8855ea2-ce37-4fa4-85d4-d8e406579766 req-6b096009-a52f-4e5a-a62a-e26c38efe74b tempest-TestInstancesWithCinderVolumes-220368711 None] Terminate volume connection completed successfully. Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-c8855ea2-ce37-4fa4-85d4-d8e406579766 req-6b096009-a52f-4e5a-a62a-e26c38efe74b tempest-TestInstancesWithCinderVolumes-220368711 None] Deleting attachment 7c754fe6-5cb2-4b81-a302-d3d1e303ad13. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:56:38 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45 Sep 07 10:56:38 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:38 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 1073741824" returned: 0 in 0.690s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:38 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-07bbb587-8483-400e-83db-fc228af87b45" returned: 0 in 0.359s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Lock "cinder-quobyte-07bbb587-8483-400e-83db-fc228af87b45" released by "delete_volume" :: held 1.143s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:38 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 Sep 07 10:56:38 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Created reservations ['166c911d-fa99-4b06-bf41-80d1c42b5944', 'e5010ada-2379-43ff-80de-67f59af72077', 'd565eb48-b61d-4239-ad1b-47d4d8b1aec7', '7dc93866-b534-41df-b378-5c518cd9f1cc'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:38 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:38 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:39 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096" returned: 0 in 0.359s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961c461a-d498-43ec-a1aa-111fa7d07be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c31c37-38b7-4705-86fd-7ec26ded5096', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f8b5ae-6cd8-45b4-b29b-9fb170512284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:56:39 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Volume volume-60c31c37-38b7-4705-86fd-7ec26ded5096 (60c31c37-38b7-4705-86fd-7ec26ded5096): created successfully Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f8b5ae-6cd8-45b4-b29b-9fb170512284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Flow 'volume_create_manager' (3c3f5eca-3d0e-46e4-acab-a632d9bf5b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:56:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-389300ff-013f-44a3-ac2f-1a38def2de84 tempest-VolumesTransfersTest-987306125 None] Created volume successfully. Sep 07 10:56:39 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.327s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Deleted volume successfully. Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bed9d990-639c-49c9-9558-1dd5f3a57f7d tempest-VolumesActionsTest-1646386310 None] Lock "cinder-07bbb587-8483-400e-83db-fc228af87b45-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "cinder-7e4c6ea8-64c0-4a4d-86db-107754f9be49-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-7e4c6ea8-64c0-4a4d-86db-107754f9be49-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "cinder-quobyte-7e4c6ea8-64c0-4a4d-86db-107754f9be49" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-quobyte-7e4c6ea8-64c0-4a4d-86db-107754f9be49" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bfa5a7-14de-4f31-8b20-8d803a439a6d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:39 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 Sep 07 10:56:39 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:39 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49" returned: 0 in 0.392s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:40 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49 Sep 07 10:56:40 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Acquiring lock "cinder-60c31c37-38b7-4705-86fd-7ec26ded5096-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Lock "cinder-60c31c37-38b7-4705-86fd-7ec26ded5096-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:40 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7e4c6ea8-64c0-4a4d-86db-107754f9be49" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Acquiring lock "cinder-quobyte-60c31c37-38b7-4705-86fd-7ec26ded5096" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-quobyte-7e4c6ea8-64c0-4a4d-86db-107754f9be49" released by "delete_volume" :: held 0.796s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Lock "cinder-quobyte-60c31c37-38b7-4705-86fd-7ec26ded5096" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[23be1444-5d28-46f8-b75d-439b1de7ce7b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:56:40 devstack cinder-volume[87271]: WARNING cinder.quota [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272147237-554903785 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272147237-554903785, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:56:40 devstack cinder-volume[87271]: WARNING cinder.quota [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272147237-554903785 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272147237-554903785, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Created reservations ['f23ee16c-c35e-46d7-b7cc-b1c08e9651bf', 'f6548277-58af-4722-877f-b049ff6dce0d', 'cf526490-076d-49df-97ab-874e2476094f', '26f8f04a-42f1-4807-a700-2d52f7166873'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:40 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 Sep 07 10:56:40 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:40 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:40 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:40 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.412s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:40 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:41 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Deleted volume successfully. Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4c410175-63ac-4080-a9f1-413080413f89 tempest-TestInstancesWithCinderVolumes-220368711 None] Lock "cinder-7e4c6ea8-64c0-4a4d-86db-107754f9be49-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:41 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096" returned: 0 in 0.652s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:41 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096 Sep 07 10:56:41 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:41 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c31c37-38b7-4705-86fd-7ec26ded5096" returned: 0 in 0.406s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Lock "cinder-quobyte-60c31c37-38b7-4705-86fd-7ec26ded5096" released by "delete_volume" :: held 1.125s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Created reservations ['5dbb4d0e-1619-4fef-969e-ba33d7520933', '2f42e163-85ac-407d-b0dc-eba482039b1e', '1945d1f5-ca83-489c-b0d9-168a94e62417', '6dc35d12-5c23-4ca1-aa7f-abd6455cca82'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:56:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:56:41 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:56:41 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:56:42 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Sep 07 10:56:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.437s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:56:42 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:56:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Deleted volume successfully. Sep 07 10:56:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d3054ce2-fced-4a71-9609-a943e199c592 tempest-VolumesTransfersTest-879023635 None] Lock "cinder-60c31c37-38b7-4705-86fd-7ec26ded5096-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:56:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-3e58bbc2-68e5-4540-a24b-f3718499508f req-ef8fc8e5-04ed-4e41-91ce-ea9cd29f818e tempest-AttachVolumeNegativeTest-942110588 None] Terminate volume connection completed successfully. Sep 07 10:56:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-3e58bbc2-68e5-4540-a24b-f3718499508f req-ef8fc8e5-04ed-4e41-91ce-ea9cd29f818e tempest-AttachVolumeNegativeTest-942110588 None] Deleting attachment 476e85d7-cea1-405d-807a-346b05cd5500. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:57:00 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Flow 'volume_create_manager' (e696246e-43d3-420b-a65a-e46a0510a8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584a31a2-6fbc-4775-a20c-b0e91c568eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584a31a2-6fbc-4775-a20c-b0e91c568eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-292159448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe657d2-a522-46c9-8a57-a3be8402c695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588819b44b4342b6bea60e0ed5060eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:01Z,use_quota=True,user_id='37308020446d4ff38c8b36be09829b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0704cd70-9f12-4519-b8b5-3d60c8c9fd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0704cd70-9f12-4519-b8b5-3d60c8c9fd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f209a60-49f2-4853-b2b6-26eacdebbbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f209a60-49f2-4853-b2b6-26eacdebbbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe657d2-a522-46c9-8a57-a3be8402c695', 'volume_name': 'volume-1fe657d2-a522-46c9-8a57-a3be8402c695', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f63e26-39b9-484c-bb5e-ca1d47a4cd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f63e26-39b9-484c-bb5e-ca1d47a4cd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5181af-8b97-4799-9738-701bb8797caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Volume 1fe657d2-a522-46c9-8a57-a3be8402c695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe657d2-a522-46c9-8a57-a3be8402c695', 'volume_size': 1} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-292159448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe657d2-a522-46c9-8a57-a3be8402c695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588819b44b4342b6bea60e0ed5060eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:01Z,use_quota=True,user_id='37308020446d4ff38c8b36be09829b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Creating volume 1fe657d2-a522-46c9-8a57-a3be8402c695 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:01 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:01 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 1073741824 Sep 07 10:57:01 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:01 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 1073741824" returned: 0 in 0.634s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:01 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 Sep 07 10:57:01 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:02 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695" returned: 0 in 0.269s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5181af-8b97-4799-9738-701bb8797caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe657d2-a522-46c9-8a57-a3be8402c695', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f6f543-61fa-4b98-8c61-ad81aa76b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Volume volume-1fe657d2-a522-46c9-8a57-a3be8402c695 (1fe657d2-a522-46c9-8a57-a3be8402c695): created successfully Sep 07 10:57:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f6f543-61fa-4b98-8c61-ad81aa76b36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Flow 'volume_create_manager' (e696246e-43d3-420b-a65a-e46a0510a8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-66e633a5-1f49-4de0-9f84-9745fdb3bf3a tempest-VolumesTransfersV355Test-1332078146 None] Created volume successfully. Sep 07 10:57:04 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:DELETE=11,cinder:UPDATE=140,cinder:SELECT=101,cinder:INSERT=25 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:57:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e139bb09-d26c-4ae1-bf6c-b364c3579d2a tempest-VolumesTransfersV355Test-1429651975 None] Transfer volume completed successfully. Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Acquiring lock "cinder-1fe657d2-a522-46c9-8a57-a3be8402c695-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-1fe657d2-a522-46c9-8a57-a3be8402c695-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=104,cinder:UPDATE=124,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Acquiring lock "cinder-quobyte-1fe657d2-a522-46c9-8a57-a3be8402c695" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-quobyte-1fe657d2-a522-46c9-8a57-a3be8402c695" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[539bbd63-5111-4725-977d-5ef2525bc7ec]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:05 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Flow 'volume_create_manager' (cb29442e-4ef7-401a-9595-99bf14b876f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:05 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afb135c-3062-458e-94ac-0471b6f3e9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afb135c-3062-458e-94ac-0471b6f3e9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2042031450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7471c4ff-a597-4408-ad6f-33fa4dd9eea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d38fbf0b801427db29fc0066a88eb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:06Z,use_quota=True,user_id='b53f60d3329a48f7a6692097c1724d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03c3e07-6671-4ee9-b3ec-6a4923e81a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03c3e07-6671-4ee9-b3ec-6a4923e81a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac190b6f-8736-44f4-a046-ae51bf834f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac190b6f-8736-44f4-a046-ae51bf834f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7471c4ff-a597-4408-ad6f-33fa4dd9eea1', 'volume_name': 'volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e45af60-1c68-4eba-bf13-431997e56930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e45af60-1c68-4eba-bf13-431997e56930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dcc845-41f5-4d77-b91d-0722050ffd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Volume 7471c4ff-a597-4408-ad6f-33fa4dd9eea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1', 'volume_size': 1} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2042031450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7471c4ff-a597-4408-ad6f-33fa4dd9eea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d38fbf0b801427db29fc0066a88eb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:06Z,use_quota=True,user_id='b53f60d3329a48f7a6692097c1724d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Creating volume 7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:06 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:06 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 1073741824 Sep 07 10:57:06 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:06 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695" returned: 0 in 0.654s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:06 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695 Sep 07 10:57:06 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:06 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 1073741824" returned: 0 in 0.656s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:06 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fe657d2-a522-46c9-8a57-a3be8402c695" returned: 0 in 0.390s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-quobyte-1fe657d2-a522-46c9-8a57-a3be8402c695" released by "delete_volume" :: held 1.098s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:06 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 Sep 07 10:57:06 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Created reservations ['8f6aa10e-26d1-44af-a0be-6bf05a82e4b7', '3ad2d4f1-33d1-4e63-a712-0411d0090c77', 'b715802a-3940-471e-8171-f730328f66ec', '7cf003b4-fdb5-4cd6-8109-72fa74dcd8cd'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:06 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:57:06 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:07 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" returned: 0 in 0.316s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dcc845-41f5-4d77-b91d-0722050ffd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb0cf12-c606-498c-9e56-26529e82be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:07 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Volume volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 (7471c4ff-a597-4408-ad6f-33fa4dd9eea1): created successfully Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb0cf12-c606-498c-9e56-26529e82be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Flow 'volume_create_manager' (cb29442e-4ef7-401a-9595-99bf14b876f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e8dc09fc-4f37-46a5-93cc-ff94617a7de4 tempest-SnapshotMetadataTestJSON-88356954 None] Created volume successfully. Sep 07 10:57:07 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.374s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:57:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Deleted volume successfully. Sep 07 10:57:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7069ebd5-64d4-4c22-b786-17c4a22912d4 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-1fe657d2-a522-46c9-8a57-a3be8402c695-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Creating offline snapshot 57836e3e-a4dd-4132-87cd-5915f22b1e29 of volume 7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2756b0-821c-4a41-9838-b81aba817e9d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:08 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 Sep 07 10:57:08 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Flow 'volume_create_manager' (6466763f-4154-4426-85d2-d788901f5d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57610bf-0f65-49be-bcb9-f258ab9b0ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57610bf-0f65-49be-bcb9-f258ab9b0ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469935871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5706221-b15c-4266-8ab2-a922dab7dce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588819b44b4342b6bea60e0ed5060eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:09Z,use_quota=True,user_id='37308020446d4ff38c8b36be09829b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbae9ca2-c034-4731-9f40-001d690e9753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbae9ca2-c034-4731-9f40-001d690e9753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e9db11-aa01-4527-9500-33d3e1842b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e9db11-aa01-4527-9500-33d3e1842b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5706221-b15c-4266-8ab2-a922dab7dce0', 'volume_name': 'volume-d5706221-b15c-4266-8ab2-a922dab7dce0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0784150-bbbc-4ba4-87e8-e65b55a7104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0784150-bbbc-4ba4-87e8-e65b55a7104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952acbad-8a64-4943-b4a4-77f9eb9c89ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:08 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Volume d5706221-b15c-4266-8ab2-a922dab7dce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5706221-b15c-4266-8ab2-a922dab7dce0', 'volume_size': 1} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:08 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" returned: 0 in 0.627s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:08 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 1G Sep 07 10:57:08 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:09 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 1G" returned: 0 in 0.520s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:09 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 Sep 07 10:57:09 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:09 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29" returned: 0 in 0.380s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:09 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 is being set with open permissions: ugo+rw Sep 07 10:57:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:09 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 Sep 07 10:57:09 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:09 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29" returned: 0 in 0.312s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:10 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.info Sep 07 10:57:10 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:10 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.info" returned: 0 in 0.363s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:10 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.info is being set with open permissions: ugo+rw Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:10 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.info Sep 07 10:57:10 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:10 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:57:10 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:10 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.info" returned: 0 in 0.317s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.047s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469935871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5706221-b15c-4266-8ab2-a922dab7dce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588819b44b4342b6bea60e0ed5060eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:09Z,use_quota=True,user_id='37308020446d4ff38c8b36be09829b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Creating volume d5706221-b15c-4266-8ab2-a922dab7dce0 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:10 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:10 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 1073741824 Sep 07 10:57:10 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-878a5579-31e7-4c94-b18c-499cb177bafe tempest-SnapshotMetadataTestJSON-88356954 None] Create snapshot completed successfully Sep 07 10:57:11 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.616s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:57:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:57:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:57:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:57:11 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 1073741824" returned: 0 in 1.069s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:11 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 Sep 07 10:57:11 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:12 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0" returned: 0 in 0.616s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952acbad-8a64-4943-b4a4-77f9eb9c89ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5706221-b15c-4266-8ab2-a922dab7dce0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ad58a8-3110-4557-bc13-06e0b684a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Volume volume-d5706221-b15c-4266-8ab2-a922dab7dce0 (d5706221-b15c-4266-8ab2-a922dab7dce0): created successfully Sep 07 10:57:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ad58a8-3110-4557-bc13-06e0b684a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Flow 'volume_create_manager' (6466763f-4154-4426-85d2-d788901f5d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f8e98e17-47ff-4e1f-9a74-09c75a28f44b tempest-VolumesTransfersV355Test-1332078146 None] Created volume successfully. Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "cinder-57836e3e-a4dd-4132-87cd-5915f22b1e29-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-57836e3e-a4dd-4132-87cd-5915f22b1e29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "cinder-quobyte-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-quobyte-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "cinder-quobyte-57836e3e-a4dd-4132-87cd-5915f22b1e29" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-quobyte-57836e3e-a4dd-4132-87cd-5915f22b1e29" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Deleting offline snapshot 57836e3e-a4dd-4132-87cd-5915f22b1e29 of volume 7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] snapshot_file for this snap is: volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2f54d3-f760-46ab-9bf5-712a3946ba76]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:13 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 Sep 07 10:57:13 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Acquiring lock "cinder-d5706221-b15c-4266-8ab2-a922dab7dce0-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-d5706221-b15c-4266-8ab2-a922dab7dce0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Acquiring lock "cinder-quobyte-d5706221-b15c-4266-8ab2-a922dab7dce0" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-quobyte-d5706221-b15c-4266-8ab2-a922dab7dce0" acquired by "delete_volume" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e316d0ad-b100-48b9-9847-88791f9ec6e5]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:14 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29" returned: 0 in 0.779s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3aba5c-05e1-4364-a747-e8ee32edbcca]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:14 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 Sep 07 10:57:14 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:14 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 Sep 07 10:57:14 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:14 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0" returned: 0 in 0.703s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:15 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0 Sep 07 10:57:15 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:15 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" returned: 0 in 0.706s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:15 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 Sep 07 10:57:15 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:15 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d5706221-b15c-4266-8ab2-a922dab7dce0" returned: 0 in 0.573s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-quobyte-d5706221-b15c-4266-8ab2-a922dab7dce0" released by "delete_volume" :: held 1.356s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:15 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29" returned: 0 in 0.589s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Created reservations ['8c2ae9a5-53bc-435d-8a4b-4dcb92e23e2f', 'd4c92cbf-788d-4da1-8d36-e612a6a2f843', '5eaa7816-4505-402a-8391-35572008266a', '6e846320-bdd4-4568-bcb4-fdc814349410'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:57:15 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29 Sep 07 10:57:15 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:15 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:57:15 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:16 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1.57836e3e-a4dd-4132-87cd-5915f22b1e29" returned: 0 in 0.362s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-quobyte-57836e3e-a4dd-4132-87cd-5915f22b1e29" released by "_delete_snapshot" :: held 2.668s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-quobyte-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" released by "delete_snapshot" :: held 2.734s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:16 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.379s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:57:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Deleted volume successfully. Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2ffa01c-b2d5-48f8-8e7e-93065db25747 tempest-VolumesTransfersV355Test-268099921 None] Lock "cinder-d5706221-b15c-4266-8ab2-a922dab7dce0-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Created reservations ['c0028849-c27b-4737-ae5f-1620fdac3b7b', '8c1ed313-0688-4735-89e8-c451036ada2d', '97cafdef-1948-455f-8666-19e56ea1db0a', 'c3d30485-6638-468c-b00f-e515a08c2ad6'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:57:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Delete snapshot completed successfully. Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-096534b3-1457-4c19-b51d-3aa5e341d806 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-57836e3e-a4dd-4132-87cd-5915f22b1e29-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "cinder-7471c4ff-a597-4408-ad6f-33fa4dd9eea1-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-7471c4ff-a597-4408-ad6f-33fa4dd9eea1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "cinder-quobyte-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-quobyte-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" acquired by "delete_volume" :: waited 0.033s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:17 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87a0d62-aff1-413a-9b77-cd7d01392a52]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:17 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 Sep 07 10:57:17 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:17 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" returned: 0 in 0.745s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:17 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1 Sep 07 10:57:17 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:18 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" returned: 0 in 0.435s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-quobyte-7471c4ff-a597-4408-ad6f-33fa4dd9eea1" released by "delete_volume" :: held 1.277s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Created reservations ['c0ae6173-d900-400d-bfcf-a07b84ec3325', '1affc832-54c3-4e18-8f69-c3ee0f4cb751', '12957514-7777-43ec-a447-67a0273eb6cc', 'f6140023-52c3-439b-8da7-fb2289f77885'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:18 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:57:18 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:18 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.395s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:57:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Deleted volume successfully. Sep 07 10:57:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-efe65b8b-ec81-466a-8d04-38e26b35a059 tempest-SnapshotMetadataTestJSON-88356954 None] Lock "cinder-7471c4ff-a597-4408-ad6f-33fa4dd9eea1-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:28 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=24,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Flow 'volume_create_manager' (e91782a4-fac9-49b1-8db0-d30e37a7eb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e156780d-8c33-4102-9e4b-f2819128eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e156780d-8c33-4102-9e4b-f2819128eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2092247680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd08728-4291-4547-83b2-578caca2b572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c92b32b6ae04071b39a4d148cf59b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:29Z,use_quota=True,user_id='0796e96dd4304686be6729d6ed7c27ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff09669f-d5b3-4d54-9dec-84b01fca7c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff09669f-d5b3-4d54-9dec-84b01fca7c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b1fa55-f0c2-4180-ad0c-d95a80dd65bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b1fa55-f0c2-4180-ad0c-d95a80dd65bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd08728-4291-4547-83b2-578caca2b572', 'volume_name': 'volume-9fd08728-4291-4547-83b2-578caca2b572', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611a6d4-1e2c-439b-9146-370f803a6181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611a6d4-1e2c-439b-9146-370f803a6181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d72690-69b6-4112-984c-8609eb1a2f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:29 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Volume 9fd08728-4291-4547-83b2-578caca2b572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd08728-4291-4547-83b2-578caca2b572', 'volume_size': 1} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2092247680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd08728-4291-4547-83b2-578caca2b572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c92b32b6ae04071b39a4d148cf59b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:29Z,use_quota=True,user_id='0796e96dd4304686be6729d6ed7c27ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Creating volume 9fd08728-4291-4547-83b2-578caca2b572 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:29 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:29 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 1073741824 Sep 07 10:57:29 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:30 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 1073741824" returned: 0 in 0.633s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:30 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 Sep 07 10:57:30 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:30 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572" returned: 0 in 0.281s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d72690-69b6-4112-984c-8609eb1a2f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd08728-4291-4547-83b2-578caca2b572', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a7660a-65f5-4669-b294-0bf13377bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:30 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Volume volume-9fd08728-4291-4547-83b2-578caca2b572 (9fd08728-4291-4547-83b2-578caca2b572): created successfully Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a7660a-65f5-4669-b294-0bf13377bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Flow 'volume_create_manager' (e91782a4-fac9-49b1-8db0-d30e37a7eb54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:30 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0ec390b2-c070-4cb3-8f2b-5f84343bb3c8 tempest-VolumesTransfersV357Test-187994330 None] Created volume successfully. Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Flow 'volume_create_manager' (e59a3b96-991c-4449-bc38-7362a6cff49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd2e287-4ece-42a2-b3dd-1468645c0ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd2e287-4ece-42a2-b3dd-1468645c0ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2066553178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57468b01-682a-4d5f-b6d5-fd90b4bad59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43683fb704a849f6a34e46c479a1c51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:31Z,use_quota=True,user_id='f7b5ade7f06747d8990a32653c3e6322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccea51cb-54da-435b-be1b-3581ea727e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccea51cb-54da-435b-be1b-3581ea727e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744f0fc0-1cf0-4c89-8474-a265310f9d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744f0fc0-1cf0-4c89-8474-a265310f9d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57468b01-682a-4d5f-b6d5-fd90b4bad59f', 'volume_name': 'volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb5884a-16d7-4770-806d-970a4ac2c31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb5884a-16d7-4770-806d-970a4ac2c31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b829936-d15b-450e-9f8b-377c6a56f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Volume 57468b01-682a-4d5f-b6d5-fd90b4bad59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f', 'volume_size': 1} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2066553178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57468b01-682a-4d5f-b6d5-fd90b4bad59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43683fb704a849f6a34e46c479a1c51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:31Z,use_quota=True,user_id='f7b5ade7f06747d8990a32653c3e6322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Creating volume 57468b01-682a-4d5f-b6d5-fd90b4bad59f {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:31 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:31 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f 1073741824 Sep 07 10:57:31 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:31 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f 1073741824" returned: 0 in 0.504s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:31 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f Sep 07 10:57:31 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:32 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f" returned: 0 in 0.307s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b829936-d15b-450e-9f8b-377c6a56f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4602d3ed-40a6-4335-8955-ba5affeab3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:32 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Volume volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f (57468b01-682a-4d5f-b6d5-fd90b4bad59f): created successfully Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4602d3ed-40a6-4335-8955-ba5affeab3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Flow 'volume_create_manager' (e59a3b96-991c-4449-bc38-7362a6cff49a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9d1065fa-58fa-41f1-a627-2c996e0224d7 tempest-AbsoluteLimitsTests-832870521 None] Created volume successfully. Sep 07 10:57:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-3cc1a96c-4e4e-4106-9d71-6c23c83409e6 tempest-VolumesTransfersV357Test-563926140 None] Transfer volume completed successfully. Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Acquiring lock "cinder-9fd08728-4291-4547-83b2-578caca2b572-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-9fd08728-4291-4547-83b2-578caca2b572-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Acquiring lock "cinder-quobyte-9fd08728-4291-4547-83b2-578caca2b572" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-quobyte-9fd08728-4291-4547-83b2-578caca2b572" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d72a32d-c228-4401-9553-629bbc2e666f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:33 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 Sep 07 10:57:33 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Acquiring lock "cinder-57468b01-682a-4d5f-b6d5-fd90b4bad59f-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:33 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572" returned: 0 in 0.507s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Lock "cinder-57468b01-682a-4d5f-b6d5-fd90b4bad59f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:33 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572 Sep 07 10:57:33 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Acquiring lock "cinder-quobyte-57468b01-682a-4d5f-b6d5-fd90b4bad59f" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Lock "cinder-quobyte-57468b01-682a-4d5f-b6d5-fd90b4bad59f" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f63b7-d1c6-42e9-bb91-cc10278b023b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:33 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f Sep 07 10:57:33 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:33 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9fd08728-4291-4547-83b2-578caca2b572" returned: 0 in 0.318s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-quobyte-9fd08728-4291-4547-83b2-578caca2b572" released by "delete_volume" :: held 0.878s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Created reservations ['1b37227f-d9b4-45da-812f-4d1dd68f1de2', 'f30c6c01-6611-4fcb-9bb9-697301fd73c4', 'ba9ace52-d3e3-43c9-8e08-6e8f46c4c8bb', 'f63c71ac-dea1-48e3-92e5-018087915992'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:34 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:57:34 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:34 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f" returned: 0 in 0.515s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:34 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f Sep 07 10:57:34 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:34 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.350s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:57:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Deleted volume successfully. Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9b3b337e-b1fb-4f33-9a36-00e0b4a717f0 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-9fd08728-4291-4547-83b2-578caca2b572-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:34 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-57468b01-682a-4d5f-b6d5-fd90b4bad59f" returned: 0 in 0.427s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Lock "cinder-quobyte-57468b01-682a-4d5f-b6d5-fd90b4bad59f" released by "delete_volume" :: held 1.016s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Created reservations ['91f1f385-d1bc-4f4d-bd76-0d837d065753', 'a9027bcb-8fb5-426e-b98b-5d4895be6157', '2dd9ebcf-4459-4d29-b111-b5c3237a843f', '834405e4-71e4-4501-ad68-af36f7e314b0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:34 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:57:34 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Flow 'volume_create_manager' (6c6fa614-5723-4ced-8853-9860ded72060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cddb19-cb8a-4d53-b8ed-b1cce8f1f226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cddb19-cb8a-4d53-b8ed-b1cce8f1f226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-102982779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5f5d57-ccf2-4483-a8e2-a193f5bedc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c92b32b6ae04071b39a4d148cf59b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:35Z,use_quota=True,user_id='0796e96dd4304686be6729d6ed7c27ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df005a7-7e73-4033-bdb6-5cfe1a967c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df005a7-7e73-4033-bdb6-5cfe1a967c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16fb42c7-57fc-42c9-85e4-0bdc394d85c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16fb42c7-57fc-42c9-85e4-0bdc394d85c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f5f5d57-ccf2-4483-a8e2-a193f5bedc35', 'volume_name': 'volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3abe347-0c2a-4e9c-b6be-2ef22c6b07c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3abe347-0c2a-4e9c-b6be-2ef22c6b07c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3979d1-6764-48b1-ac83-d37460842a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Volume 3f5f5d57-ccf2-4483-a8e2-a193f5bedc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35', 'volume_size': 1} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-102982779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5f5d57-ccf2-4483-a8e2-a193f5bedc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c92b32b6ae04071b39a4d148cf59b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:35Z,use_quota=True,user_id='0796e96dd4304686be6729d6ed7c27ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Creating volume 3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:35 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:35 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 1073741824 Sep 07 10:57:35 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:35 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.282s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:57:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Deleted volume successfully. Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-86358c9c-3048-4089-b6e2-40f06aa01f6c tempest-AbsoluteLimitsTests-832870521 None] Lock "cinder-57468b01-682a-4d5f-b6d5-fd90b4bad59f-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:35 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 1073741824" returned: 0 in 0.469s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:35 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 Sep 07 10:57:35 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:35 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35" returned: 0 in 0.253s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3979d1-6764-48b1-ac83-d37460842a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781b1db8-325d-4889-b64d-c3d89997a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Volume volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 (3f5f5d57-ccf2-4483-a8e2-a193f5bedc35): created successfully Sep 07 10:57:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781b1db8-325d-4889-b64d-c3d89997a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Flow 'volume_create_manager' (6c6fa614-5723-4ced-8853-9860ded72060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9a0e05e3-e7fe-4415-a88e-c078c384b03b tempest-VolumesTransfersV357Test-187994330 None] Created volume successfully. Sep 07 10:57:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Acquiring lock "cinder-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Acquiring lock "cinder-quobyte-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-quobyte-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:37 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d177f5-8ff5-4c7a-8672-427abd8aa1a8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:38 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 Sep 07 10:57:38 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Flow 'volume_create_manager' (5fd7d971-f9f7-44ee-8748-c441e13d7a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dbbe99-50d4-40ae-a252-b97b040fe442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dbbe99-50d4-40ae-a252-b97b040fe442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1511058213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a42a93a-0a92-4614-af6c-5466a10dfe1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0d8f279ad542729610c848966266d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:38Z,use_quota=True,user_id='5e554620408b485ea2516f40f0b2e6f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6256c36d-2c8e-42dd-8476-4d19b5b0762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6256c36d-2c8e-42dd-8476-4d19b5b0762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce65c60-aa95-44f0-bd69-37a147264b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce65c60-aa95-44f0-bd69-37a147264b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a42a93a-0a92-4614-af6c-5466a10dfe1a', 'volume_name': 'volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af24555-864f-4e75-9ee4-26933ad70d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af24555-864f-4e75-9ee4-26933ad70d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702c4034-6c5f-475d-b277-5638b994a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Volume 8a42a93a-0a92-4614-af6c-5466a10dfe1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a', 'volume_size': 1} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1511058213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a42a93a-0a92-4614-af6c-5466a10dfe1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0d8f279ad542729610c848966266d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:38Z,use_quota=True,user_id='5e554620408b485ea2516f40f0b2e6f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Creating volume 8a42a93a-0a92-4614-af6c-5466a10dfe1a {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:38 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:38 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a 1073741824 Sep 07 10:57:38 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:38 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35" returned: 0 in 0.556s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:38 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35 Sep 07 10:57:38 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:38 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-quobyte-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35" released by "delete_volume" :: held 0.989s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Created reservations ['52248c82-dc5c-46c5-a560-9d8b27f7df76', 'a3d8faa9-a651-43f5-b170-f57629d91452', '8640b52c-a160-4a73-96e7-9a7afe576bf8', '74a34a33-fbc9-49bd-9682-261fa6e4053f'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:39 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:39 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:57:39 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a 1073741824" returned: 0 in 0.794s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:39 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a Sep 07 10:57:39 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:39 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.364s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:57:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Deleted volume successfully. Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-68e65d9e-c922-4b45-936f-c2bbb6c8d277 tempest-VolumesTransfersV357Test-1699328997 None] Lock "cinder-3f5f5d57-ccf2-4483-a8e2-a193f5bedc35-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:57:39 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a" returned: 0 in 0.388s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702c4034-6c5f-475d-b277-5638b994a306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b3a70e-04a7-4d6c-9907-326c91d39614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:39 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Volume volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a (8a42a93a-0a92-4614-af6c-5466a10dfe1a): created successfully Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b3a70e-04a7-4d6c-9907-326c91d39614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Flow 'volume_create_manager' (5fd7d971-f9f7-44ee-8748-c441e13d7a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e29536f1-a5af-4cd3-8ac9-72d0c47ae588 tempest-AttachVolumeNegativeTest-942110588 None] Created volume successfully. Sep 07 10:57:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-6c95dda3-5dc5-4d6f-8f17-807923efabd0 req-aaab9660-b5b0-4b0f-96f5-41ff53a254d3 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-6c95dda3-5dc5-4d6f-8f17-807923efabd0 req-aaab9660-b5b0-4b0f-96f5-41ff53a254d3 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-6c95dda3-5dc5-4d6f-8f17-807923efabd0 req-aaab9660-b5b0-4b0f-96f5-41ff53a254d3 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-6c95dda3-5dc5-4d6f-8f17-807923efabd0 req-aaab9660-b5b0-4b0f-96f5-41ff53a254d3 tempest-AttachVolumeNegativeTest-942110588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a12c5c29-f594-4df4-bfb8-8503208009c1', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:57:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-6c95dda3-5dc5-4d6f-8f17-807923efabd0 req-aaab9660-b5b0-4b0f-96f5-41ff53a254d3 tempest-AttachVolumeNegativeTest-942110588 None] attachment_update completed successfully. Sep 07 10:57:45 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-b7ccd89c-b69e-4189-8d65-9c02eccfbee4 req-3ec475ea-4e0f-45ac-8542-d7da443473c3 tempest-AttachVolumeNegativeTest-942110588 None] Terminate volume connection completed successfully. Sep 07 10:57:45 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-b7ccd89c-b69e-4189-8d65-9c02eccfbee4 req-3ec475ea-4e0f-45ac-8542-d7da443473c3 tempest-AttachVolumeNegativeTest-942110588 None] Deleting attachment a12c5c29-f594-4df4-bfb8-8503208009c1. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Flow 'volume_create_manager' (0a57d644-15e5-4f98-8a1a-97d13b34c2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2624248f-9aec-4dc8-ba7a-da106385b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2624248f-9aec-4dc8-ba7a-da106385b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1216827319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b670001-25f4-46e7-b44f-f2695b101c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444af2a2d7664d7481192cdc97439865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:47Z,use_quota=True,user_id='e8b150003aac40338fbb328bf7cef215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bef8f3d-e785-4506-b02f-96153809fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bef8f3d-e785-4506-b02f-96153809fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ddeefa-9aa3-47ed-9cf1-f114273b12ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Flow 'volume_create_manager' (a8974c9c-8a6a-4230-9d13-7ae023393f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf4052-59fa-4fa2-80ed-f572392fd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf4052-59fa-4fa2-80ed-f572392fd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-124407435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591e3f00-51ee-4955-a986-fd52d30705fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce279ee6634b44b5934493650b79f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:47Z,use_quota=True,user_id='6eb15c41e23041958b8ed3b66153d169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839f0cda-914d-4c77-b249-b0d812625d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839f0cda-914d-4c77-b249-b0d812625d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c43f6c-bebd-4a9b-b1e0-6f10aa2ba8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c43f6c-bebd-4a9b-b1e0-6f10aa2ba8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591e3f00-51ee-4955-a986-fd52d30705fa', 'volume_name': 'volume-591e3f00-51ee-4955-a986-fd52d30705fa', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2f55a6-7f54-4c1b-af92-c26923812b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2f55a6-7f54-4c1b-af92-c26923812b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8171424-0c2d-4e28-ac1d-7c2f35ae7158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:47 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Volume 591e3f00-51ee-4955-a986-fd52d30705fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591e3f00-51ee-4955-a986-fd52d30705fa', 'volume_size': 1} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-124407435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591e3f00-51ee-4955-a986-fd52d30705fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce279ee6634b44b5934493650b79f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:47Z,use_quota=True,user_id='6eb15c41e23041958b8ed3b66153d169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Creating volume 591e3f00-51ee-4955-a986-fd52d30705fa {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:47 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:47 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa 1073741824 Sep 07 10:57:47 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ddeefa-9aa3-47ed-9cf1-f114273b12ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b670001-25f4-46e7-b44f-f2695b101c16', 'volume_name': 'volume-0b670001-25f4-46e7-b44f-f2695b101c16', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08144ed-d238-41bc-a468-33bf27745e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08144ed-d238-41bc-a468-33bf27745e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f74219d-deb5-49ee-8585-e502f4a6200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:48 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Volume 0b670001-25f4-46e7-b44f-f2695b101c16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b670001-25f4-46e7-b44f-f2695b101c16', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 10:57:48 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Trying to clone 0b670001-25f4-46e7-b44f-f2695b101c16 from image 705abe21-5cec-4130-9cb9-f60544709b95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:57:48 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa 1073741824" returned: 0 in 0.894s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:48 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa Sep 07 10:57:48 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:57:49 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Image download 20.69 MB at 20.69 MB/s Sep 07 10:57:49 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa" returned: 0 in 0.535s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[210df401-9b20-4d3b-8e26-b28ff2b5e2ad]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8171424-0c2d-4e28-ac1d-7c2f35ae7158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591e3f00-51ee-4955-a986-fd52d30705fa', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5677fc-43fe-4fac-a48d-0d3f1d7cd0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:49 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Volume volume-591e3f00-51ee-4955-a986-fd52d30705fa (591e3f00-51ee-4955-a986-fd52d30705fa): created successfully Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5677fc-43fe-4fac-a48d-0d3f1d7cd0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Flow 'volume_create_manager' (a8974c9c-8a6a-4230-9d13-7ae023393f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-330e32f3-edcc-4f82-837a-72fe1781009f tempest-TestMinimumBasicScenario-898654301 None] Created volume successfully. Sep 07 10:57:49 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD Sep 07 10:57:49 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:50 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 is fetched for user e8b150003aac40338fbb328bf7cef215. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b717c436-480b-479a-baef-85f3786a4d64]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:50 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD Sep 07 10:57:50 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:50 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD" returned: 0 in 0.683s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1216827319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b670001-25f4-46e7-b44f-f2695b101c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444af2a2d7664d7481192cdc97439865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:47Z,use_quota=True,user_id='e8b150003aac40338fbb328bf7cef215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Creating volume 0b670001-25f4-46e7-b44f-f2695b101c16 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:50 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:51 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 1073741824 Sep 07 10:57:51 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-191d3177-5782-4248-be5d-8570df806a08 req-90bccc1d-300f-4d64-b456-afdf9444dd10 tempest-TestMinimumBasicScenario-898654301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:51 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 1073741824" returned: 0 in 0.689s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:51 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 Sep 07 10:57:51 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:52 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-191d3177-5782-4248-be5d-8570df806a08 req-90bccc1d-300f-4d64-b456-afdf9444dd10 tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.617s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-191d3177-5782-4248-be5d-8570df806a08 req-90bccc1d-300f-4d64-b456-afdf9444dd10 tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Attempting download of 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume 0b670001-25f4-46e7-b44f-f2695b101c16. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-191d3177-5782-4248-be5d-8570df806a08 req-90bccc1d-300f-4d64-b456-afdf9444dd10 tempest-TestMinimumBasicScenario-898654301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-591e3f00-51ee-4955-a986-fd52d30705fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7b57561-a731-454f-9475-1fab9b50d909', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0d66d-48ef-4bb0-bb3d-8c990a9539d8]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_mbha7ioc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-191d3177-5782-4248-be5d-8570df806a08 req-90bccc1d-300f-4d64-b456-afdf9444dd10 tempest-TestMinimumBasicScenario-898654301 None] attachment_update completed successfully. Sep 07 10:57:52 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_mbha7ioc Sep 07 10:57:52 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:52 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_mbha7ioc" returned: 0 in 0.614s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_mbha7ioc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:53 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_mbha7ioc Sep 07 10:57:53 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:53 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_mbha7ioc" returned: 1 in 0.420s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_mbha7ioc' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c94d756-ba69-4e2b-9d1a-e8f7285f2f2f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:53 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD Sep 07 10:57:53 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Flow 'volume_create_manager' (ef49910f-050a-4774-92f5-7e6a41f0a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698f7172-da60-4250-b536-e9e4c638e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698f7172-da60-4250-b536-e9e4c638e293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-87346259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8afc86-e12c-4c28-a8e8-46039382706c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8547b83a577440338fd032fba4ff7290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:54Z,use_quota=True,user_id='fc698d7d4363417199cb88748f36dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97fa215-958b-4008-b808-c657922e7313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97fa215-958b-4008-b808-c657922e7313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e94453-50b5-4474-bfee-ff28af706775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e94453-50b5-4474-bfee-ff28af706775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8afc86-e12c-4c28-a8e8-46039382706c', 'volume_name': 'volume-6f8afc86-e12c-4c28-a8e8-46039382706c', 'volume_size': 2}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cc564c-e22f-4db4-912b-c79a78b81e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cc564c-e22f-4db4-912b-c79a78b81e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65296f50-c4e6-4722-8d1a-5e0e1006fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:53 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Volume 6f8afc86-e12c-4c28-a8e8-46039382706c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8afc86-e12c-4c28-a8e8-46039382706c', 'volume_size': 2} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-87346259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8afc86-e12c-4c28-a8e8-46039382706c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8547b83a577440338fd032fba4ff7290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:57:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:57:54Z,use_quota=True,user_id='fc698d7d4363417199cb88748f36dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Creating volume 6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:57:53 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:57:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c 2147483648 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:54 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD" returned: 0 in 0.691s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:54 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] 705abe21-5cec-4130-9cb9-f60544709b95 was qcow2, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:57:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:54 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c 2147483648 Sep 07 10:57:54 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:54 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 Sep 07 10:57:54 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:54 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c 2147483648" returned: 0 in 0.599s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:54 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c Sep 07 10:57:54 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:55 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c" returned: 0 in 0.524s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:57:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65296f50-c4e6-4722-8d1a-5e0e1006fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8afc86-e12c-4c28-a8e8-46039382706c', 'volume_size': 2}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226b828f-d8f2-4355-aafc-e20cb3d0895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:55 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Volume volume-6f8afc86-e12c-4c28-a8e8-46039382706c (6f8afc86-e12c-4c28-a8e8-46039382706c): created successfully Sep 07 10:57:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226b828f-d8f2-4355-aafc-e20cb3d0895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Flow 'volume_create_manager' (ef49910f-050a-4774-92f5-7e6a41f0a06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cd39febb-2dfd-4918-98bd-4c2ba529a8a4 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Created volume successfully. Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Creating offline snapshot 5f23546e-a78e-4684-ae18-1e13cd7ec551 of volume 6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abc295e-5c64-4192-b806-d52e4de12fa7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:56 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c Sep 07 10:57:56 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:56 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16" returned: 0 in 2.502s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_u3xkkls8devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:57:56 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Converted 112.00 MB image at 44.73 MB/s Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:56 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 1G Sep 07 10:57:56 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:56 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c" returned: 0 in 0.506s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 2G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:56 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 2G Sep 07 10:57:56 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:56 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 1G" returned: 0 in 0.390s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Downloaded image 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume 0b670001-25f4-46e7-b44f-f2695b101c16 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 for user e8b150003aac40338fbb328bf7cef215 is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Marking volume 0b670001-25f4-46e7-b44f-f2695b101c16 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Copying metadata from image 705abe21-5cec-4130-9cb9-f60544709b95 to 0b670001-25f4-46e7-b44f-f2695b101c16. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:57:56 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Creating volume glance metadata for volume 0b670001-25f4-46e7-b44f-f2695b101c16 backed by image 705abe21-5cec-4130-9cb9-f60544709b95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f74219d-deb5-49ee-8585-e502f4a6200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b670001-25f4-46e7-b44f-f2695b101c16', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9306a1b-d365-48df-9378-5d9d704c97b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:57:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Volume volume-0b670001-25f4-46e7-b44f-f2695b101c16 (0b670001-25f4-46e7-b44f-f2695b101c16): created successfully Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9306a1b-d365-48df-9378-5d9d704c97b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Flow 'volume_create_manager' (0a57d644-15e5-4f98-8a1a-97d13b34c2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:57:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-3b855db5-91c1-4b7f-b43a-dac6a67979ec tempest-VolumesExtendTest-487455250 None] Created volume successfully. Sep 07 10:57:57 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 2G" returned: 0 in 0.604s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8afc86-e12c-4c28-a8e8-46039382706c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:57 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8afc86-e12c-4c28-a8e8-46039382706c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 Sep 07 10:57:57 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:57 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8afc86-e12c-4c28-a8e8-46039382706c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551" returned: 0 in 0.363s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:57 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 is being set with open permissions: ugo+rw Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:57 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 Sep 07 10:57:57 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:57 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551" returned: 0 in 0.285s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:58 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.info Sep 07 10:57:58 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:57:58 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.info" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:58 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.info is being set with open permissions: ugo+rw Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:58 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.info Sep 07 10:57:58 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:58 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.info" returned: 0 in 0.393s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.749s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.460s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3981322-fd5c-40b9-a196-7c82462e18e2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-49737167-07fe-4fa2-b143-84cb2ba8ff8e tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Create snapshot completed successfully Sep 07 10:57:59 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 Sep 07 10:57:59 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:57:59 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16" returned: 0 in 0.650s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 2G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "cinder-5f23546e-a78e-4684-ae18-1e13cd7ec551-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-5f23546e-a78e-4684-ae18-1e13cd7ec551-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "cinder-quobyte-6f8afc86-e12c-4c28-a8e8-46039382706c" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-quobyte-6f8afc86-e12c-4c28-a8e8-46039382706c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "cinder-quobyte-5f23546e-a78e-4684-ae18-1e13cd7ec551" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-quobyte-5f23546e-a78e-4684-ae18-1e13cd7ec551" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Deleting offline snapshot 5f23546e-a78e-4684-ae18-1e13cd7ec551 of volume 6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] snapshot_file for this snap is: volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 2G" returned: 0 in 0.177s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.870s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e41c2ab-f1f6-44f0-b1c4-df5478944887]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:57:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:57:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-15d9ec34-0810-4d2e-9241-a04921361f03 tempest-VolumesExtendTest-487455250 None] Extend volume completed successfully. Sep 07 10:57:59 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 Sep 07 10:57:59 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:00 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551" returned: 0 in 0.581s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f8afc86-e12c-4c28-a8e8-46039382706c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:58:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[465979bf-7d2f-4def-89d2-5056e73073a3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:00 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c Sep 07 10:58:00 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:00 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c" returned: 0 in 0.424s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:00 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 Sep 07 10:58:00 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Acquiring lock "cinder-0b670001-25f4-46e7-b44f-f2695b101c16-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:01 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Lock "cinder-0b670001-25f4-46e7-b44f-f2695b101c16-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551" returned: 0 in 0.445s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:01 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551 Sep 07 10:58:01 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Acquiring lock "cinder-quobyte-0b670001-25f4-46e7-b44f-f2695b101c16" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-0b670001-25f4-46e7-b44f-f2695b101c16" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6281d93e-dfe0-484b-982d-fd1cefe00a17]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:01 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 Sep 07 10:58:01 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:01 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c.5f23546e-a78e-4684-ae18-1e13cd7ec551" returned: 0 in 0.362s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-quobyte-5f23546e-a78e-4684-ae18-1e13cd7ec551" released by "_delete_snapshot" :: held 1.993s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-quobyte-6f8afc86-e12c-4c28-a8e8-46039382706c" released by "delete_snapshot" :: held 2.034s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:01 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Created reservations ['68905362-b8e2-40da-826b-eec6a00d14b3', '41560083-4db7-40f4-8c28-3ebad6f2c7a9', '1aa0b408-8862-4e7c-b217-f4c2f11d652f', '8c566bcb-e36d-4192-8882-97df496d57d3'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Delete snapshot completed successfully. Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fbdcdc91-bc88-48c8-9976-23c61d33a3ca tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-5f23546e-a78e-4684-ae18-1e13cd7ec551-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:02 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16" returned: 0 in 0.604s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:02 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16 Sep 07 10:58:02 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:02 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0b670001-25f4-46e7-b44f-f2695b101c16" returned: 0 in 0.342s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-0b670001-25f4-46e7-b44f-f2695b101c16" released by "delete_volume" :: held 1.006s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Created reservations ['6d62e3d8-fb25-43aa-a8ac-ee2d93d02550', '6d993b14-5b27-41f0-a13f-af2d32035c8b', 'e1ea5c18-dac2-485d-8144-965ce8a5f401', '4c29dba2-bd9c-46c9-85e7-106b70e95fa5'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:02 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:02 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:02 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.290s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Deleted volume successfully. Sep 07 10:58:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7eb30a2b-229c-4685-928e-741d730eb1bb tempest-VolumesExtendTest-487455250 None] Lock "cinder-0b670001-25f4-46e7-b44f-f2695b101c16-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "cinder-6f8afc86-e12c-4c28-a8e8-46039382706c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-6f8afc86-e12c-4c28-a8e8-46039382706c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "cinder-quobyte-6f8afc86-e12c-4c28-a8e8-46039382706c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-quobyte-6f8afc86-e12c-4c28-a8e8-46039382706c" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b684c-e484-42d8-bbca-18137ed9f2bd]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:03 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c Sep 07 10:58:03 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:04 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c" returned: 0 in 0.898s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:04 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c Sep 07 10:58:04 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:04 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-6f8afc86-e12c-4c28-a8e8-46039382706c" returned: 0 in 0.603s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-quobyte-6f8afc86-e12c-4c28-a8e8-46039382706c" released by "delete_volume" :: held 1.726s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:04 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=107,cinder:UPDATE=98,cinder:INSERT=35,cinder:DELETE=8 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Flow 'volume_create_manager' (421f6cf8-992a-41f9-8792-ff2c8f9da2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a175a1e-401a-4aac-8087-9d060a8cf5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a175a1e-401a-4aac-8087-9d060a8cf5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1827514125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667a97da-6ee3-45ca-8ba5-c37c622aa53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444af2a2d7664d7481192cdc97439865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:05Z,use_quota=True,user_id='e8b150003aac40338fbb328bf7cef215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bc81fc-d527-4e3a-a450-2bd60cd1ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bc81fc-d527-4e3a-a450-2bd60cd1ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96f5281-df75-46d5-b647-a0820e1de8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96f5281-df75-46d5-b647-a0820e1de8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667a97da-6ee3-45ca-8ba5-c37c622aa53c', 'volume_name': 'volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a723c8b4-2b26-49f4-97e6-cb644cd94f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a723c8b4-2b26-49f4-97e6-cb644cd94f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e851b6-0367-4463-94e4-0a65e2152be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Volume 667a97da-6ee3-45ca-8ba5-c37c622aa53c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c', 'volume_size': 1} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1827514125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667a97da-6ee3-45ca-8ba5-c37c622aa53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444af2a2d7664d7481192cdc97439865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:05Z,use_quota=True,user_id='e8b150003aac40338fbb328bf7cef215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Creating volume 667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:58:05 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Created reservations ['bb75bfac-9357-48ae-9bc3-e5f318b5e697', '27f23e85-e663-4f0c-8d90-07b0ead06481', '8e843e31-9a7c-4c43-8482-607ea175b52c', '5e368f74-70d7-4f65-bf96-d5640e4ab3b0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:05 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c 1073741824 Sep 07 10:58:05 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:05 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:05 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:05 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.503s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:05 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Deleted volume successfully. Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7b42367a-a841-46b0-ad05-6c70feac83c8 tempest-VolumesSnapshotNegativeTestJSON-2079428800 None] Lock "cinder-6f8afc86-e12c-4c28-a8e8-46039382706c-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:06 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c 1073741824" returned: 0 in 0.970s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:06 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c Sep 07 10:58:06 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:06 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c" returned: 0 in 0.437s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e851b6-0367-4463-94e4-0a65e2152be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267ec170-f76d-41d9-8bd0-c03a096e96e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:06 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Volume volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c (667a97da-6ee3-45ca-8ba5-c37c622aa53c): created successfully Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267ec170-f76d-41d9-8bd0-c03a096e96e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Flow 'volume_create_manager' (421f6cf8-992a-41f9-8792-ff2c8f9da2a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:06 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-691b7cb7-1a47-426e-82fe-1f7dc0819f54 tempest-VolumesExtendTest-487455250 None] Created volume successfully. Sep 07 10:58:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Creating offline snapshot 2a92478f-142c-4d0d-a73c-daa3531e4b5d of volume 667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:58:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7bf91-c1f6-493b-a1ef-89a59cee5cd5]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:07 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c Sep 07 10:58:07 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:08 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c" returned: 0 in 0.546s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:08 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d 1G Sep 07 10:58:08 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:09 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d 1G" returned: 0 in 0.678s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:09 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d Sep 07 10:58:09 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:09 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d" returned: 0 in 0.381s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:09 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d is being set with open permissions: ugo+rw Sep 07 10:58:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:09 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d Sep 07 10:58:09 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:09 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d" returned: 0 in 0.390s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:09 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.info Sep 07 10:58:09 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:10 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.info" returned: 0 in 0.483s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:10 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.info is being set with open permissions: ugo+rw Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:10 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.info Sep 07 10:58:10 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:10 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:10 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:10 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.info" returned: 0 in 0.545s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.230s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:11 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.432s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:58:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:58:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:58:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ce9dae5d-292d-4adf-8524-d1f46f1870a0 tempest-VolumesExtendTest-487455250 None] Create snapshot completed successfully Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d475e-63fd-43e8-8763-8bf9c7906934]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:12 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c Sep 07 10:58:12 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:12 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c" returned: 0 in 0.482s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d 2G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d 2G" returned: 0 in 0.150s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.670s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a5b86685-a753-42ad-bd8d-09b53ad14eb3 tempest-VolumesExtendTest-487455250 None] Extend volume completed successfully. Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Acquiring lock "cinder-2a92478f-142c-4d0d-a73c-daa3531e4b5d-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Lock "cinder-2a92478f-142c-4d0d-a73c-daa3531e4b5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Acquiring lock "cinder-quobyte-667a97da-6ee3-45ca-8ba5-c37c622aa53c" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-667a97da-6ee3-45ca-8ba5-c37c622aa53c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Acquiring lock "cinder-quobyte-2a92478f-142c-4d0d-a73c-daa3531e4b5d" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-2a92478f-142c-4d0d-a73c-daa3531e4b5d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Deleting offline snapshot 2a92478f-142c-4d0d-a73c-daa3531e4b5d of volume 667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] snapshot_file for this snap is: volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8fd153-8472-4039-9636-06807dc4d0da]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:13 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d Sep 07 10:58:13 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:13 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d" returned: 0 in 0.414s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb0c71-e431-4124-a8a9-99dd1dfba040]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:14 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c Sep 07 10:58:14 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:14 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c" returned: 0 in 0.416s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:14 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d Sep 07 10:58:14 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:14 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d" returned: 0 in 0.469s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:14 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d Sep 07 10:58:14 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:15 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c.2a92478f-142c-4d0d-a73c-daa3531e4b5d" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-2a92478f-142c-4d0d-a73c-daa3531e4b5d" released by "_delete_snapshot" :: held 1.738s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-667a97da-6ee3-45ca-8ba5-c37c622aa53c" released by "delete_snapshot" :: held 1.775s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Created reservations ['b6631b62-3c66-459d-99a8-abd48fac985f', '8961310d-ec3f-4f1e-9101-856f1d214d0c', '2eaa059d-4afa-4cbd-a414-91e62a56892c', '348c7df9-4232-4d6d-aaf2-661cbcc03911'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Delete snapshot completed successfully. Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5c440ca7-7d0b-4687-809a-db6e9ac05b60 tempest-VolumesExtendTest-487455250 None] Lock "cinder-2a92478f-142c-4d0d-a73c-daa3531e4b5d-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Acquiring lock "cinder-667a97da-6ee3-45ca-8ba5-c37c622aa53c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Lock "cinder-667a97da-6ee3-45ca-8ba5-c37c622aa53c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Acquiring lock "cinder-quobyte-667a97da-6ee3-45ca-8ba5-c37c622aa53c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-667a97da-6ee3-45ca-8ba5-c37c622aa53c" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7af903-dcd9-4e92-b176-d84e6e6653c8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:16 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c Sep 07 10:58:16 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:16 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c" returned: 0 in 0.454s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:16 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c Sep 07 10:58:16 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:16 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-667a97da-6ee3-45ca-8ba5-c37c622aa53c" returned: 0 in 0.272s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Lock "cinder-quobyte-667a97da-6ee3-45ca-8ba5-c37c622aa53c" released by "delete_volume" :: held 0.803s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Created reservations ['9be8dc82-c41b-4ec9-bb60-9b72a6ad8afb', '8857018e-6c05-4102-a45a-a01d64d92bb8', '653b9581-115f-4300-b624-28ebecce0e3a', 'a1a451a1-f10c-47af-8b10-79d9ef9bb339'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:16 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:16 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:17 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.474s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:17 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Deleted volume successfully. Sep 07 10:58:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c896feb0-1402-47e6-bf46-cfb0e310b178 tempest-VolumesExtendTest-487455250 None] Lock "cinder-667a97da-6ee3-45ca-8ba5-c37c622aa53c-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:26 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:INSERT=3,cinder:UPDATE=28,cinder:SELECT=18,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:58:27 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=86,cinder:UPDATE=97,cinder:DELETE=11,cinder:INSERT=28 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Flow 'volume_create_manager' (93aedb45-ecbe-4992-8908-a369bc960a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab1f8fd-c310-4d15-b366-1d02112f3944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab1f8fd-c310-4d15-b366-1d02112f3944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1798189966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f863b1c6-fc81-4799-b290-b1f45ebd6b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0d8f279ad542729610c848966266d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:31Z,use_quota=True,user_id='5e554620408b485ea2516f40f0b2e6f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2974b-3acd-46f7-9b05-20aac01908e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2974b-3acd-46f7-9b05-20aac01908e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdc5c6b-a7cb-4fc5-a464-0009a40d2fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdc5c6b-a7cb-4fc5-a464-0009a40d2fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f863b1c6-fc81-4799-b290-b1f45ebd6b9b', 'volume_name': 'volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a454f4-a16c-4fe3-b2c4-79f10226a675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a454f4-a16c-4fe3-b2c4-79f10226a675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2f1b5a-c692-40e6-b569-29d7496df60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Volume f863b1c6-fc81-4799-b290-b1f45ebd6b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b', 'volume_size': 1} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1798189966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f863b1c6-fc81-4799-b290-b1f45ebd6b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0d8f279ad542729610c848966266d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:31Z,use_quota=True,user_id='5e554620408b485ea2516f40f0b2e6f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Creating volume f863b1c6-fc81-4799-b290-b1f45ebd6b9b {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:58:31 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:58:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:31 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b 1073741824 Sep 07 10:58:31 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:32 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b 1073741824" returned: 0 in 1.016s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:32 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b Sep 07 10:58:32 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:32 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2f1b5a-c692-40e6-b569-29d7496df60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7741d9f8-81f1-4d38-a8bb-0f02e8d9fd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:32 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Volume volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b (f863b1c6-fc81-4799-b290-b1f45ebd6b9b): created successfully Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7741d9f8-81f1-4d38-a8bb-0f02e8d9fd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Flow 'volume_create_manager' (93aedb45-ecbe-4992-8908-a369bc960a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-df754f4a-e920-4f25-a441-f8bbbe8010d0 tempest-AttachVolumeNegativeTest-942110588 None] Created volume successfully. Sep 07 10:58:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-1414da49-d1aa-4ed2-92c0-94287b7e1d92 req-38606302-c585-4a73-bea9-cc69acc626eb tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-1414da49-d1aa-4ed2-92c0-94287b7e1d92 req-38606302-c585-4a73-bea9-cc69acc626eb tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-1414da49-d1aa-4ed2-92c0-94287b7e1d92 req-38606302-c585-4a73-bea9-cc69acc626eb tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-1414da49-d1aa-4ed2-92c0-94287b7e1d92 req-38606302-c585-4a73-bea9-cc69acc626eb tempest-AttachVolumeNegativeTest-942110588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bef33476-9d4b-43b9-95cc-f822a33edd5b', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:58:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-1414da49-d1aa-4ed2-92c0-94287b7e1d92 req-38606302-c585-4a73-bea9-cc69acc626eb tempest-AttachVolumeNegativeTest-942110588 None] attachment_update completed successfully. Sep 07 10:58:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-9623888a-037c-44fd-8308-191a3eac6331 req-49f398c9-3c24-494b-93ab-bb9c75be20a1 tempest-AttachVolumeNegativeTest-942110588 None] Terminate volume connection completed successfully. Sep 07 10:58:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-9623888a-037c-44fd-8308-191a3eac6331 req-49f398c9-3c24-494b-93ab-bb9c75be20a1 tempest-AttachVolumeNegativeTest-942110588 None] Deleting attachment bef33476-9d4b-43b9-95cc-f822a33edd5b. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Flow 'volume_create_manager' (c8a46997-c19a-4b2d-9b05-086f127ffa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da437c76-12d3-4ddf-bedb-396d1428e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da437c76-12d3-4ddf-bedb-396d1428e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1729297689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c02a8e-b34c-49bb-a7d6-ed700cfe872d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a813f659b5e94fd2a4a4bb56c9e81ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:48Z,use_quota=True,user_id='ca77cbb05f384ce79b9809bb9553da7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b382f2d-c932-4ce4-9c60-ad87bed1072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b382f2d-c932-4ce4-9c60-ad87bed1072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0779f87-58c3-4758-bdc8-df3a18b1116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0779f87-58c3-4758-bdc8-df3a18b1116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c02a8e-b34c-49bb-a7d6-ed700cfe872d', 'volume_name': 'volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17af698-d3d3-4fcb-a961-72a7838649a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17af698-d3d3-4fcb-a961-72a7838649a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa528e4-1722-4c75-9f32-9bf3f6ce1763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:47 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Volume c7c02a8e-b34c-49bb-a7d6-ed700cfe872d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d', 'volume_size': 1} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1729297689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c02a8e-b34c-49bb-a7d6-ed700cfe872d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a813f659b5e94fd2a4a4bb56c9e81ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:48Z,use_quota=True,user_id='ca77cbb05f384ce79b9809bb9553da7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Creating volume c7c02a8e-b34c-49bb-a7d6-ed700cfe872d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:58:47 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:58:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:47 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d 1073741824 Sep 07 10:58:47 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:48 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d 1073741824" returned: 0 in 0.747s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:48 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d Sep 07 10:58:48 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:48 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" returned: 0 in 0.348s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:58:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa528e4-1722-4c75-9f32-9bf3f6ce1763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b790685e-ca39-457b-b1a7-afa9f129a5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:49 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Volume volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d (c7c02a8e-b34c-49bb-a7d6-ed700cfe872d): created successfully Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b790685e-ca39-457b-b1a7-afa9f129a5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Flow 'volume_create_manager' (c8a46997-c19a-4b2d-9b05-086f127ffa1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ac08ed23-fbd1-41e6-84aa-2d1ac4cca728 tempest-TestImageHashVerification-1916468723 None] Created volume successfully. Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Flow 'volume_create_manager' (aab7e9fa-263f-4491-a9c6-12cd527fd73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e87a21-e0b1-4cc3-be82-f42fda8d527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e87a21-e0b1-4cc3-be82-f42fda8d527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1829732053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89005779-65a4-4e95-896f-762147675d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9a7561dea49fda65538ebeba01583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:49Z,use_quota=True,user_id='01605f74a93e4ab3a51905be947ef771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a3a98c-81bf-49b4-87b8-50751c790caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a3a98c-81bf-49b4-87b8-50751c790caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548a339d-71da-4ba6-94ec-b88d88426fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548a339d-71da-4ba6-94ec-b88d88426fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89005779-65a4-4e95-896f-762147675d81', 'volume_name': 'volume-89005779-65a4-4e95-896f-762147675d81', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1067af-d61b-440f-b7a7-e2234380b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1067af-d61b-440f-b7a7-e2234380b195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b97b61-1cdb-4091-9e0b-5df851f02341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:49 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Volume 89005779-65a4-4e95-896f-762147675d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89005779-65a4-4e95-896f-762147675d81', 'volume_size': 1} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1829732053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89005779-65a4-4e95-896f-762147675d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9a7561dea49fda65538ebeba01583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:49Z,use_quota=True,user_id='01605f74a93e4ab3a51905be947ef771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Creating volume 89005779-65a4-4e95-896f-762147675d81 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:58:49 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:49 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 1073741824 Sep 07 10:58:49 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "cinder-f863b1c6-fc81-4799-b290-b1f45ebd6b9b-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-f863b1c6-fc81-4799-b290-b1f45ebd6b9b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "cinder-quobyte-f863b1c6-fc81-4799-b290-b1f45ebd6b9b" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-quobyte-f863b1c6-fc81-4799-b290-b1f45ebd6b9b" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e48e37-a132-4794-aec2-63d57d8fa490]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Flow 'volume_create_manager' (d35c8e2f-2762-41fd-a0e5-99cd1e6327c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0455485c-d34e-4555-a598-a8d2de24c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0455485c-d34e-4555-a598-a8d2de24c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-853697026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3d01a2-e1fb-454a-9110-700c7c1c62c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9a7561dea49fda65538ebeba01583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:50Z,use_quota=True,user_id='01605f74a93e4ab3a51905be947ef771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8535895-4398-4b6f-8e55-0716db2d436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8535895-4398-4b6f-8e55-0716db2d436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5f2b1d-1ecc-43c6-847a-bcf9eb737031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5f2b1d-1ecc-43c6-847a-bcf9eb737031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3d01a2-e1fb-454a-9110-700c7c1c62c1', 'volume_name': 'volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc43ad5-46e6-47ad-b0fe-4cd0b527f7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc43ad5-46e6-47ad-b0fe-4cd0b527f7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176f9e8b-28b1-4b1d-9232-7da0ef089dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:50 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Volume 9b3d01a2-e1fb-454a-9110-700c7c1c62c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1', 'volume_size': 1} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:50 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 1073741824" returned: 0 in 0.771s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:50 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b Sep 07 10:58:50 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:50 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 Sep 07 10:58:50 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:50 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81" returned: 0 in 0.463s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:50 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-853697026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3d01a2-e1fb-454a-9110-700c7c1c62c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9a7561dea49fda65538ebeba01583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:58:50Z,use_quota=True,user_id='01605f74a93e4ab3a51905be947ef771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Creating volume 9b3d01a2-e1fb-454a-9110-700c7c1c62c1 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:58:50 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b" returned: 0 in 0.855s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:50 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 1073741824 Sep 07 10:58:50 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b97b61-1cdb-4091-9e0b-5df851f02341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89005779-65a4-4e95-896f-762147675d81', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:50 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b Sep 07 10:58:50 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0309eb-4d3a-4c26-b6fd-829bf00d2473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:51 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Volume volume-89005779-65a4-4e95-896f-762147675d81 (89005779-65a4-4e95-896f-762147675d81): created successfully Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0309eb-4d3a-4c26-b6fd-829bf00d2473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Flow 'volume_create_manager' (aab7e9fa-263f-4491-a9c6-12cd527fd73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2acd73f9-20be-4875-9e7e-d46c314e0cd2 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Created volume successfully. Sep 07 10:58:51 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f863b1c6-fc81-4799-b290-b1f45ebd6b9b" returned: 0 in 0.423s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-quobyte-f863b1c6-fc81-4799-b290-b1f45ebd6b9b" released by "delete_volume" :: held 1.337s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Created reservations ['fbdf39fe-d242-4354-a0be-bdb5ad4973fc', 'b777ca9d-f2c8-4eab-a850-7d3d773ba825', '180db33b-0b49-4b0e-82f0-992742565907', '627abe30-6e3e-4c39-ad55-3b18cc3d62c4'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:51 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:51 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:51 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 1073741824" returned: 0 in 0.781s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:51 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 Sep 07 10:58:51 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:51 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.359s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:51 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Deleted volume successfully. Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-78ee967a-91f4-464f-92d2-55abc0e293d6 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-f863b1c6-fc81-4799-b290-b1f45ebd6b9b-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:52 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1" returned: 0 in 0.382s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.053s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176f9e8b-28b1-4b1d-9232-7da0ef089dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2158114-c1a3-45f0-bfab-4d926ea995c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22360cf-42e7-4c9f-a5ef-792c1d52b420]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:52 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Volume volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 (9b3d01a2-e1fb-454a-9110-700c7c1c62c1): created successfully Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2158114-c1a3-45f0-bfab-4d926ea995c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Flow 'volume_create_manager' (d35c8e2f-2762-41fd-a0e5-99cd1e6327c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:58:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-20ed2362-f108-4f7c-adbb-2f44f8c89206 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Created volume successfully. Sep 07 10:58:52 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d Sep 07 10:58:52 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "cinder-8a42a93a-0a92-4614-af6c-5466a10dfe1a-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-8a42a93a-0a92-4614-af6c-5466a10dfe1a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "cinder-quobyte-8a42a93a-0a92-4614-af6c-5466a10dfe1a" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-quobyte-8a42a93a-0a92-4614-af6c-5466a10dfe1a" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[777e7b80-d08e-4f2b-974b-0e03fb404493]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:52 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a Sep 07 10:58:52 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" returned: 0 in 0.628s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:52 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb8a91-19ea-4c1c-a4fe-c6d59f588aa3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:52 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d Sep 07 10:58:52 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:53 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a" returned: 0 in 0.664s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:53 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a Sep 07 10:58:53 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:53 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" returned: 0 in 0.549s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d /opt/stack/data/cinder/conversion/c7c02a8e-b34c-49bb-a7d6-ed700cfe872d.temp_image.608600ce-f48d-4b0e-80de-eeeaae16e4e3ir98z8sm.img {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:53 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d /opt/stack/data/cinder/conversion/c7c02a8e-b34c-49bb-a7d6-ed700cfe872d.temp_image.608600ce-f48d-4b0e-80de-eeeaae16e4e3ir98z8sm.img Sep 07 10:58:53 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:53 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8a42a93a-0a92-4614-af6c-5466a10dfe1a" returned: 0 in 0.447s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-quobyte-8a42a93a-0a92-4614-af6c-5466a10dfe1a" released by "delete_volume" :: held 1.215s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:53 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-2586ab02-1cf0-42d4-a9ca-eab5ac6431d4 req-0a4f7d07-aa41-4c79-8a75-0d7d85638a7b tempest-TestMinimumBasicScenario-898654301 None] Terminate volume connection completed successfully. Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-2586ab02-1cf0-42d4-a9ca-eab5ac6431d4 req-0a4f7d07-aa41-4c79-8a75-0d7d85638a7b tempest-TestMinimumBasicScenario-898654301 None] Deleting attachment f7b57561-a731-454f-9475-1fab9b50d909. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:58:53 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Created reservations ['dca5d16b-c9c7-4929-9cfe-d55b38d5a3f8', 'c1a8c9df-2b25-4eea-a189-13db550a1b26', '5870b6f0-fbd6-4dc2-af6c-fe2248e4f696', 'cd159937-c12f-4a11-83e0-b95c8de173ae'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:54 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:54 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Acquiring lock "cinder-591e3f00-51ee-4955-a986-fd52d30705fa-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Lock "cinder-591e3f00-51ee-4955-a986-fd52d30705fa-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Acquiring lock "cinder-quobyte-591e3f00-51ee-4955-a986-fd52d30705fa" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Lock "cinder-quobyte-591e3f00-51ee-4955-a986-fd52d30705fa" acquired by "delete_volume" :: waited 0.037s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:55 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.878s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Deleted volume successfully. Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[0113dc9a-1150-4ac1-aa57-b74d365e5b20]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15f96a1c-7ae8-4dcf-bcaa-a77e98022968 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-8a42a93a-0a92-4614-af6c-5466a10dfe1a-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:55 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa Sep 07 10:58:55 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "cinder-38c3e93e-1745-4248-9db6-24c83ca6af21-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-38c3e93e-1745-4248-9db6-24c83ca6af21-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "cinder-quobyte-38c3e93e-1745-4248-9db6-24c83ca6af21" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-quobyte-38c3e93e-1745-4248-9db6-24c83ca6af21" acquired by "delete_volume" :: waited 0.045s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d817643-bec7-47c2-8f5e-1ef62d0f1f91]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:55 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa" returned: 0 in 0.733s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:55 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa Sep 07 10:58:55 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:56 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 Sep 07 10:58:56 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:56 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-591e3f00-51ee-4955-a986-fd52d30705fa" returned: 0 in 0.762s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Lock "cinder-quobyte-591e3f00-51ee-4955-a986-fd52d30705fa" released by "delete_volume" :: held 1.635s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:56 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Created reservations ['7e6cc318-f687-4a7a-a52e-6980a4c50339', 'bae68572-3101-49eb-9301-b48908799a56', 'f7d55637-9789-4e69-ad1b-e4c014359c11', '9a15be10-96d1-44d4-8baf-d4dd773ebc72'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:56 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21" returned: 0 in 1.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:56 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21 Sep 07 10:58:56 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:57 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:57 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:57 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-38c3e93e-1745-4248-9db6-24c83ca6af21" returned: 0 in 0.512s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-quobyte-38c3e93e-1745-4248-9db6-24c83ca6af21" released by "delete_volume" :: held 1.894s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Created reservations ['bc6a2e3f-60fd-4674-8158-33de0ce70451', '04e1f8b3-b3ff-4f06-8e8d-eb9a4b9a0a2a', '90d7f2cb-cc1c-47aa-ad92-e9636b8cdadc', '28668134-8a73-4aeb-919e-76d54712220d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.770s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:57 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:57 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:58:57 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:58:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Deleted volume successfully. Sep 07 10:58:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-240c6a5d-bb51-4f6a-8442-beb855c03bee tempest-TestMinimumBasicScenario-898654301 None] Lock "cinder-591e3f00-51ee-4955-a986-fd52d30705fa-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:58:58 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 07 10:58:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.564s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:58:58 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:58:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Deleted volume successfully. Sep 07 10:58:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c948dd1b-fa44-4f59-ba50-61f194b03775 tempest-AttachVolumeNegativeTest-942110588 None] Lock "cinder-38c3e93e-1745-4248-9db6-24c83ca6af21-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d /opt/stack/data/cinder/conversion/c7c02a8e-b34c-49bb-a7d6-ed700cfe872d.temp_image.608600ce-f48d-4b0e-80de-eeeaae16e4e3ir98z8sm.img" returned: 0 in 6.888s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5db0e6-30ac-46a2-b839-41fdb117f460]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:00 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d Sep 07 10:59:00 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:01 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" returned: 0 in 0.921s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:01 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/conversion/c7c02a8e-b34c-49bb-a7d6-ed700cfe872d.temp_image.608600ce-f48d-4b0e-80de-eeeaae16e4e3ir98z8sm.img {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:59:01 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Converted 1024.00 MB image at 148.64 MB/s Sep 07 10:59:01 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] 608600ce-f48d-4b0e-80de-eeeaae16e4e3 was raw, no need to convert to raw {{(pid=87271) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 10:59:08 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=27,cinder:UPDATE=42,cinder:DELETE=6,cinder:INSERT=12 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:59:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:59:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:10 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:59:10 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:11 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.495s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:59:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:59:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:59:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:59:11 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=40,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:59:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28d4bd76-86a9-4697-a54c-95bb5f790dd1 tempest-BackendsCapabilitiesAdminTestsJSON-186034630 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5923080444336, 'free_capacity_gb': 1773.5923080444336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87271) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 10:59:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ecf0e39c-cdf6-4177-9696-ea7b919e9561 tempest-BackendsCapabilitiesAdminTestsJSON-186034630 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5923080444336, 'free_capacity_gb': 1773.5923080444336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87271) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 10:59:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cd8a9f03-8e14-485f-89b1-40a2b8ecad2b tempest-GroupSnapshotsTest-2075329994 None] Group tempest-GroupSnapshotsTest-Group-1003831565: creating Sep 07 10:59:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cd8a9f03-8e14-485f-89b1-40a2b8ecad2b tempest-GroupSnapshotsTest-2075329994 None] Group tempest-GroupSnapshotsTest-Group-1003831565: created successfully Sep 07 10:59:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cd8a9f03-8e14-485f-89b1-40a2b8ecad2b tempest-GroupSnapshotsTest-2075329994 None] Create group completed successfully. Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (e2dfecdf-b645-42cf-a7f1-6c734b75ffd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e308bb7-b80c-4ac0-bfcd-1c7dc479aa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e308bb7-b80c-4ac0-bfcd-1c7dc479aa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537998476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c152d2b8-e192-4c69-84a2-1b7aaeaf6516,host='devstack@QuobyteHD#QuobyteHD',id=83eabc07-25db-4ad6-a14c-81b7e7455d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:59:26Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1964f88-35bc-4767-b7f9-71b56f0e2134),volume_type_id=d1964f88-35bc-4767-b7f9-71b56f0e2134)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4d5bbe-4d37-4c81-8528-3d8470910ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4d5bbe-4d37-4c81-8528-3d8470910ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea36c780-90aa-4df0-9082-ec1cb21c6e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea36c780-90aa-4df0-9082-ec1cb21c6e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83eabc07-25db-4ad6-a14c-81b7e7455d6a', 'volume_name': 'volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbc31e7-fb57-4f67-b895-56b6c5f7967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbc31e7-fb57-4f67-b895-56b6c5f7967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66264d7a-388c-44b3-8637-c06fff714ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:26 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Volume 83eabc07-25db-4ad6-a14c-81b7e7455d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a', 'volume_size': 1} Sep 07 10:59:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.710s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Uploaded volume to glance image-id: 608600ce-f48d-4b0e-80de-eeeaae16e4e3. {{(pid=87271) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.606s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c152d2b8-e192-4c69-84a2-1b7aaeaf6516,created_at=2026-09-07T08:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537998476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c152d2b8-e192-4c69-84a2-1b7aaeaf6516,host='devstack@QuobyteHD#QuobyteHD',id=83eabc07-25db-4ad6-a14c-81b7e7455d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:59:26Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1964f88-35bc-4767-b7f9-71b56f0e2134),volume_type_id=d1964f88-35bc-4767-b7f9-71b56f0e2134)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Creating volume 83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:59:31 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:59:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:31 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a 1073741824 Sep 07 10:59:31 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9aaa43a0-7575-4bac-9e15-f61e57cd0ff4 tempest-TestImageHashVerification-1916468723 None] Copy volume to image completed successfully. Sep 07 10:59:32 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a 1073741824" returned: 0 in 0.707s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:32 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a Sep 07 10:59:32 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:32 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a" returned: 0 in 0.380s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:59:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66264d7a-388c-44b3-8637-c06fff714ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec3ffab-120a-4129-bac3-e70641a8c986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:33 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Volume volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a (83eabc07-25db-4ad6-a14c-81b7e7455d6a): created successfully Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec3ffab-120a-4129-bac3-e70641a8c986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (e2dfecdf-b645-42cf-a7f1-6c734b75ffd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:59:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bd7a2f13-f484-4b07-a495-a89ddb5c97e7 tempest-GroupSnapshotsTest-2075329994 None] Created volume successfully. Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Acquiring lock "cinder-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Lock "cinder-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Acquiring lock "cinder-quobyte-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Lock "cinder-quobyte-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[57159fd7-f43b-46a5-873d-9c50982ab391]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:33 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d Sep 07 10:59:33 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:33 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" returned: 0 in 0.491s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:33 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d Sep 07 10:59:33 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] GroupSnapshot 1c11a2d4-b0af-4095-b057-49058206eccd: creating. Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Group snapshot 1c11a2d4-b0af-4095-b057-49058206eccd: creating. {{(pid=87271) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Creating offline snapshot 76a20083-13fa-44fb-8ddd-724591c1878f of volume 83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe1066a-478a-4ebd-8e87-267f6b0f688f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:34 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a Sep 07 10:59:34 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:34 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" returned: 0 in 0.400s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Lock "cinder-quobyte-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d" released by "delete_volume" :: held 0.946s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Created reservations ['fbb1f6f2-cc0a-4591-ba93-a99a34e12c1f', '96ef4616-db93-4b72-9255-89f42f801a36', '9261212f-fcfc-42b4-a6a1-d3e13d471e97', '5b5e9e9c-3122-4574-a92b-46e837504b0b'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:34 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:59:34 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:34 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a" returned: 0 in 0.544s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:34 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f 1G Sep 07 10:59:34 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:34 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.302s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:59:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Deleted volume successfully. Sep 07 10:59:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bb09f1c8-bd61-4abb-9eb1-3064f5a1aedf tempest-TestImageHashVerification-1916468723 None] Lock "cinder-c7c02a8e-b34c-49bb-a7d6-ed700cfe872d-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:35 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f 1G" returned: 0 in 0.554s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:35 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f Sep 07 10:59:35 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-dcc40f55-f5fd-4d25-9466-43ceab07d61c req-81220b88-66ad-4395-91ed-6d235266a8fc tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:35 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:35 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:59:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:35 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f Sep 07 10:59:35 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:36 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f" returned: 0 in 0.408s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:36 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.info Sep 07 10:59:36 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:36 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.info" returned: 0 in 0.389s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:36 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.info Sep 07 10:59:36 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:36 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.info" returned: 0 in 0.297s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.703s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-dcc40f55-f5fd-4d25-9466-43ceab07d61c req-81220b88-66ad-4395-91ed-6d235266a8fc tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.325s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-dcc40f55-f5fd-4d25-9466-43ceab07d61c req-81220b88-66ad-4395-91ed-6d235266a8fc tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-dcc40f55-f5fd-4d25-9466-43ceab07d61c req-81220b88-66ad-4395-91ed-6d235266a8fc tempest-TestServerVolumeAttachmentScenario-1639548885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-89005779-65a4-4e95-896f-762147675d81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b40dacf9-4de4-4617-abb3-eb21a394a882', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:59:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6d059a2c-52d5-48b5-889c-d07944d6bd1c tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 1c11a2d4-b0af-4095-b057-49058206eccd: created successfully Sep 07 10:59:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-dcc40f55-f5fd-4d25-9466-43ceab07d61c req-81220b88-66ad-4395-91ed-6d235266a8fc tempest-TestServerVolumeAttachmentScenario-1639548885 None] attachment_update completed successfully. Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-76a20083-13fa-44fb-8ddd-724591c1878f-f16ed53f-e3b7-4134-bfd5-89a002aca222" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-76a20083-13fa-44fb-8ddd-724591c1878f-f16ed53f-e3b7-4134-bfd5-89a002aca222" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Creating volume f16ed53f-e3b7-4134-bfd5-89a002aca222 from snapshot 76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-f16ed53f-e3b7-4134-bfd5-89a002aca222" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f16ed53f-e3b7-4134-bfd5-89a002aca222" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] snapshot: 76a20083-13fa-44fb-8ddd-724591c1878f, volume: f16ed53f-e3b7-4134-bfd5-89a002aca222, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1881e4-567d-4243-aae3-45e39435ee60]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:38 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f Sep 07 10:59:38 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:38 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f" returned: 0 in 0.622s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e4983d-c695-43e5-893f-109f6d268f24]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:39 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a Sep 07 10:59:39 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:39 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a" returned: 0 in 0.453s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:59:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:59:39 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:59:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:39 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 Sep 07 10:59:39 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-a6185fd5-10bb-4f57-a80c-eb6bd8b88adc req-1928927e-3065-42d7-a1c3-71f675d984bb tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:46 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222" returned: 0 in 6.706s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:59:46 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Converted 1024.00 MB image at 152.68 MB/s Sep 07 10:59:46 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:46 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 Sep 07 10:59:46 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:46 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222" returned: 0 in 0.264s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f16ed53f-e3b7-4134-bfd5-89a002aca222" released by "_copy_volume_from_snapshot" :: held 8.188s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-76a20083-13fa-44fb-8ddd-724591c1878f-f16ed53f-e3b7-4134-bfd5-89a002aca222" released by "_create_volume_from_snapshot" :: held 8.275s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.306s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-a6185fd5-10bb-4f57-a80c-eb6bd8b88adc req-1928927e-3065-42d7-a1c3-71f675d984bb tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.209s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-a6185fd5-10bb-4f57-a80c-eb6bd8b88adc req-1928927e-3065-42d7-a1c3-71f675d984bb tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-a6185fd5-10bb-4f57-a80c-eb6bd8b88adc req-1928927e-3065-42d7-a1c3-71f675d984bb tempest-TestServerVolumeAttachmentScenario-1639548885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9d513e7-59e1-44c7-a8a5-5697ce83acd6', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:59:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f3865f44-cbcf-4c2a-864b-20964e2822df tempest-GroupSnapshotsTest-2075329994 None] Create group from source-snapshot-1c11a2d4-b0af-4095-b057-49058206eccd completed successfully. Sep 07 10:59:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-a6185fd5-10bb-4f57-a80c-eb6bd8b88adc req-1928927e-3065-42d7-a1c3-71f675d984bb tempest-TestServerVolumeAttachmentScenario-1639548885 None] attachment_update completed successfully. Sep 07 10:59:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-f16ed53f-e3b7-4134-bfd5-89a002aca222" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f16ed53f-e3b7-4134-bfd5-89a002aca222" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:47 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e976f5e5-89a4-42d5-a4c2-112f09cda4c6]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:48 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 Sep 07 10:59:48 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:48 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222" returned: 0 in 0.458s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:48 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222 Sep 07 10:59:48 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:48 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f16ed53f-e3b7-4134-bfd5-89a002aca222" returned: 0 in 0.391s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f16ed53f-e3b7-4134-bfd5-89a002aca222" released by "delete_volume" :: held 0.912s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:48 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-68003111-47fc-451a-b51a-049d4be9cf94 req-1cf26622-f8bf-46a0-8cb7-ee7994682f19 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Terminate volume connection completed successfully. Sep 07 10:59:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-68003111-47fc-451a-b51a-049d4be9cf94 req-1cf26622-f8bf-46a0-8cb7-ee7994682f19 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Deleting attachment a9d513e7-59e1-44c7-a8a5-5697ce83acd6. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:59:48 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['01327a9b-90d7-4a12-b954-40170d080a57'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:48 devstack cinder-volume[87271]: WARNING cinder.quota [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-994626740 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-994626740, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:59:48 devstack cinder-volume[87271]: WARNING cinder.quota [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-994626740 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-994626740, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:59:48 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['fb10450e-e085-4ee9-856b-b57a344a148f', '0990d8d1-33ac-4456-bc83-205448be8eea', '5239f28a-d8eb-44a8-8d79-d6901d31b6e0', '8717b997-1b5d-4c05-b2b0-9ee3ac3ad706'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:49 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:59:49 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:49 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.319s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:49 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:59:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-27a82c73-0b72-4556-a03b-f30bb079eac0 tempest-GroupSnapshotsTest-2075329994 None] Delete group completed successfully. Sep 07 10:59:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 1c11a2d4-b0af-4095-b057-49058206eccd: deleting Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 1c11a2d4-b0af-4095-b057-49058206eccd: deleting {{(pid=87271) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-83eabc07-25db-4ad6-a14c-81b7e7455d6a" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-83eabc07-25db-4ad6-a14c-81b7e7455d6a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-76a20083-13fa-44fb-8ddd-724591c1878f" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-76a20083-13fa-44fb-8ddd-724591c1878f" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Deleting offline snapshot 76a20083-13fa-44fb-8ddd-724591c1878f of volume 83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] snapshot_file for this snap is: volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a5a6fd-0bba-4613-a6ae-8dc69aa2b8e2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-91f2e498-1f0e-4c84-b8eb-447c1d86a1b6 req-856814d7-67b5-4c62-bf99-36bf2dac4de0 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Terminate volume connection completed successfully. Sep 07 10:59:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-91f2e498-1f0e-4c84-b8eb-447c1d86a1b6 req-856814d7-67b5-4c62-bf99-36bf2dac4de0 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Deleting attachment b40dacf9-4de4-4617-abb3-eb21a394a882. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:59:50 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f Sep 07 10:59:50 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:51 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f" returned: 0 in 0.472s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:59:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee6c590-c1fd-4010-8c1c-9b1d10a3862d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:51 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a Sep 07 10:59:51 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:51 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a" returned: 0 in 0.768s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:51 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f Sep 07 10:59:51 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:52 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f" returned: 0 in 0.568s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:52 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f Sep 07 10:59:52 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:52 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a.76a20083-13fa-44fb-8ddd-724591c1878f" returned: 0 in 0.323s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-76a20083-13fa-44fb-8ddd-724591c1878f" released by "_delete_snapshot" :: held 2.336s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-83eabc07-25db-4ad6-a14c-81b7e7455d6a" released by "delete_snapshot" :: held 2.385s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:52 devstack cinder-volume[87271]: WARNING cinder.quota [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-994626740 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-994626740, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:59:52 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['38055e52-4bc4-4246-9026-f5b9450ce32a', 'd17cee74-51ca-4299-8c47-d3ecb3a35903', '109d235d-9e7d-49f6-875b-d2ada66690ca', 'c3fb0970-2185-455b-8ef3-b9913e685f33'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:53 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-807f9c32-7b33-450d-9b32-5424dbb964ce tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 1c11a2d4-b0af-4095-b057-49058206eccd: deleted successfully Sep 07 10:59:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-83eabc07-25db-4ad6-a14c-81b7e7455d6a" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-83eabc07-25db-4ad6-a14c-81b7e7455d6a" acquired by "delete_volume" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:54 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f94442d-ff52-4c6e-8008-acf2517a5a1d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:54 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a Sep 07 10:59:54 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:55 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a" returned: 0 in 0.549s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:55 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a Sep 07 10:59:55 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:55 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-83eabc07-25db-4ad6-a14c-81b7e7455d6a" returned: 0 in 0.336s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-83eabc07-25db-4ad6-a14c-81b7e7455d6a" released by "delete_volume" :: held 0.976s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (e35bb64f-3b6b-4327-a90a-bfce3a294638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf6fab2-7d7d-422d-862e-de9552d3a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf6fab2-7d7d-422d-862e-de9552d3a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960416920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e738f397-b887-44e5-83c5-d4bbc86696f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:59:56Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648938a2-4115-447f-96e6-771714452cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648938a2-4115-447f-96e6-771714452cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b06e492-3b29-4d97-b0aa-a3eff7aa862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b06e492-3b29-4d97-b0aa-a3eff7aa862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e738f397-b887-44e5-83c5-d4bbc86696f0', 'volume_name': 'volume-e738f397-b887-44e5-83c5-d4bbc86696f0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53e850-5db4-420f-b304-dc03f8358c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53e850-5db4-420f-b304-dc03f8358c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5c1e03-fd00-4c77-848d-daff2fca1c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:55 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume e738f397-b887-44e5-83c5-d4bbc86696f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e738f397-b887-44e5-83c5-d4bbc86696f0', 'volume_size': 1} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960416920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e738f397-b887-44e5-83c5-d4bbc86696f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:59:56Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Creating volume e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:59:55 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:55 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 1073741824 Sep 07 10:59:55 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['35ba7b4c-b9dd-4d72-8d17-9ccae2705a04'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:55 devstack cinder-volume[87271]: WARNING cinder.db.api [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-994626740'] Sep 07 10:59:55 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['27d782bd-8335-41c7-b1a9-ffd16bf78439', '4f24af86-6ec2-49ab-bc5b-0855e511c310', 'd525c990-7bfc-4e05-8646-d14248fb181d', 'cd225f37-70b5-40f7-980d-d2fe657e7732'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:56 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:59:56 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:56 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 1073741824" returned: 0 in 0.639s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:56 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.322s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:59:56 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0c090942-bee2-4efd-a101-dc8eef86c6db tempest-GroupSnapshotsTest-2075329994 None] Delete group completed successfully. Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:56 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 Sep 07 10:59:56 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:56 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0" returned: 0 in 0.290s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5c1e03-fd00-4c77-848d-daff2fca1c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e738f397-b887-44e5-83c5-d4bbc86696f0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6c7376-36b4-49d5-bade-facb65b272e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:56 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume volume-e738f397-b887-44e5-83c5-d4bbc86696f0 (e738f397-b887-44e5-83c5-d4bbc86696f0): created successfully Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6c7376-36b4-49d5-bade-facb65b272e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (e35bb64f-3b6b-4327-a90a-bfce3a294638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:59:56 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fd7b5b41-50e1-4c4e-9b84-e63e7dac00a5 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created volume successfully. Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "cinder-9b3d01a2-e1fb-454a-9110-700c7c1c62c1-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-9b3d01a2-e1fb-454a-9110-700c7c1c62c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "cinder-quobyte-9b3d01a2-e1fb-454a-9110-700c7c1c62c1" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-quobyte-9b3d01a2-e1fb-454a-9110-700c7c1c62c1" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8158490-6581-4fb3-96ea-eca7b30e526a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:57 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 Sep 07 10:59:57 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:57 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a24013cb-27ae-4485-a221-351a3ae5b639 tempest-GroupSnapshotsTest-2075329994 None] Group tempest-GroupSnapshotsTest-Group-385009830: creating Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:57 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1 Sep 07 10:59:57 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a24013cb-27ae-4485-a221-351a3ae5b639 tempest-GroupSnapshotsTest-2075329994 None] Group tempest-GroupSnapshotsTest-Group-385009830: created successfully Sep 07 10:59:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a24013cb-27ae-4485-a221-351a3ae5b639 tempest-GroupSnapshotsTest-2075329994 None] Create group completed successfully. Sep 07 10:59:57 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9b3d01a2-e1fb-454a-9110-700c7c1c62c1" returned: 0 in 0.280s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-quobyte-9b3d01a2-e1fb-454a-9110-700c7c1c62c1" released by "delete_volume" :: held 0.798s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Creating offline snapshot 8be0f4ad-1050-408c-8354-a6a942487326 of volume e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4982116a-f1ce-420e-9ec1-47d9c0775f0e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:57 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Created reservations ['f57c2790-dccf-4523-9597-40afd990559b', 'e9fe5b47-7287-45ae-ab8d-604b8897d6bc', '3e7fce38-994c-4937-b0df-bb043f30d9dd', '82c06c34-d063-48b6-bfad-1b0f3a0a6968'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:58 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 Sep 07 10:59:58 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:58 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:59:58 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "cinder-89005779-65a4-4e95-896f-762147675d81-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-89005779-65a4-4e95-896f-762147675d81-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "cinder-quobyte-89005779-65a4-4e95-896f-762147675d81" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-quobyte-89005779-65a4-4e95-896f-762147675d81" acquired by "delete_volume" :: waited 0.038s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[08448325-7473-450f-b7b6-892aed7e87e6]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:58 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.402s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:59:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Deleted volume successfully. Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d6934d20-f492-4fff-9a72-9baecc163a1f tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-9b3d01a2-e1fb-454a-9110-700c7c1c62c1-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:58 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0" returned: 0 in 0.584s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:58 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 Sep 07 10:59:58 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 1G Sep 07 10:59:58 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:58 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:58 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81" returned: 0 in 0.537s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:58 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81 Sep 07 10:59:58 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:59 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 1G" returned: 0 in 0.548s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e738f397-b887-44e5-83c5-d4bbc86696f0 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:59 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e738f397-b887-44e5-83c5-d4bbc86696f0 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 Sep 07 10:59:59 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:59 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-89005779-65a4-4e95-896f-762147675d81" returned: 0 in 0.369s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-quobyte-89005779-65a4-4e95-896f-762147675d81" released by "delete_volume" :: held 0.987s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (305b8642-0930-49f2-a439-f0e4d5443bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c09984-c83d-468e-8a6e-c84684a1d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c09984-c83d-468e-8a6e-c84684a1d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1855718016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=509d56a2-853a-43b8-9664-5af820e696fe,host='devstack@QuobyteHD#QuobyteHD',id=2653371d-a02d-47b9-ae24-8b7fcded2fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:59:59Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334eb368-955a-4fd6-bbf9-39880629db21),volume_type_id=334eb368-955a-4fd6-bbf9-39880629db21)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69b8549-a1c0-42ac-b7b5-99ef70bbcf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69b8549-a1c0-42ac-b7b5-99ef70bbcf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab3d3e2-19b7-454d-8b17-28c803feaeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab3d3e2-19b7-454d-8b17-28c803feaeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2653371d-a02d-47b9-ae24-8b7fcded2fc4', 'volume_name': 'volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc336855-df2c-45bd-85af-6e52ec100e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc336855-df2c-45bd-85af-6e52ec100e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9ce5dd-2973-41ae-986c-e36d751f8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:59:59 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Volume 2653371d-a02d-47b9-ae24-8b7fcded2fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4', 'volume_size': 1} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Created reservations ['646e44ba-707c-4452-ae07-bc8b739a0ebd', '9f420b96-de85-46d2-89d6-4af08c5a76cb', '1b1d250c-a3ea-4bc9-b074-2bb5a0eaebf1', '8707cd29-42c7-4a49-bdff-165ed559932f'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:59:59 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e738f397-b887-44e5-83c5-d4bbc86696f0 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326" returned: 0 in 0.472s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:59 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 is being set with open permissions: ugo+rw Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:59 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 Sep 07 10:59:59 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:59 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 10:59:59 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:59 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326" returned: 0 in 0.267s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:59:59 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 07 10:59:59 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.info Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:59:59 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:59:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Deleted volume successfully. Sep 07 10:59:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ecf6735d-949b-447e-957e-6122e6f68bc9 tempest-TestServerVolumeAttachmentScenario-1639548885 None] Lock "cinder-89005779-65a4-4e95-896f-762147675d81-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:00 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.info" returned: 0 in 0.301s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:00 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.info is being set with open permissions: ugo+rw Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:00 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.info Sep 07 11:00:00 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:00 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.info" returned: 0 in 0.275s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=509d56a2-853a-43b8-9664-5af820e696fe,created_at=2026-09-07T08:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1855718016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=509d56a2-853a-43b8-9664-5af820e696fe,host='devstack@QuobyteHD#QuobyteHD',id=2653371d-a02d-47b9-ae24-8b7fcded2fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:59:59Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334eb368-955a-4fd6-bbf9-39880629db21),volume_type_id=334eb368-955a-4fd6-bbf9-39880629db21)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Creating volume 2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:00 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:00 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 1073741824 Sep 07 11:00:00 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-dee1fe9c-01d6-4216-82ab-ff391c9bbc16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Create snapshot completed successfully Sep 07 11:00:01 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 1073741824" returned: 0 in 0.639s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:01 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 Sep 07 11:00:01 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:01 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4" returned: 0 in 0.442s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9ce5dd-2973-41ae-986c-e36d751f8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c877f2-88cf-49fb-9acc-9a0f4ecaae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Volume volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 (2653371d-a02d-47b9-ae24-8b7fcded2fc4): created successfully Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c877f2-88cf-49fb-9acc-9a0f4ecaae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (305b8642-0930-49f2-a439-f0e4d5443bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-17b69a90-2899-44e2-b7fb-c2d91ebc21f2 tempest-GroupSnapshotsTest-2075329994 None] Created volume successfully. Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (a1981ebb-6c83-4015-bb00-839c5b2aad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322164c7-2624-4ff8-8751-6ea996b8409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322164c7-2624-4ff8-8751-6ea996b8409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919528293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da004f4-0951-46d9-bed2-20a3bd37995d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:02Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa471708-7917-4c4f-b29f-7d4668b945b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa471708-7917-4c4f-b29f-7d4668b945b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1787309e-67e0-4533-b583-a686fed07fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1787309e-67e0-4533-b583-a686fed07fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da004f4-0951-46d9-bed2-20a3bd37995d', 'volume_name': 'volume-7da004f4-0951-46d9-bed2-20a3bd37995d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdc436c-56ae-4153-a396-615c2cb67d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdc436c-56ae-4153-a396-615c2cb67d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510ae364-14b2-49cc-acd7-ca72c4fe6ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume 7da004f4-0951-46d9-bed2-20a3bd37995d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da004f4-0951-46d9-bed2-20a3bd37995d', 'volume_size': 1} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919528293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da004f4-0951-46d9-bed2-20a3bd37995d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:02Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Creating volume 7da004f4-0951-46d9-bed2-20a3bd37995d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:02 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:02 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d 1073741824 Sep 07 11:00:02 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Flow 'volume_create_manager' (71e19595-1eda-4df4-9691-249949ecb253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3725f78-6a85-4bda-8291-d0bef0f71d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3725f78-6a85-4bda-8291-d0bef0f71d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-368344484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fceca44f-da6a-430d-aba3-e086162dc72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43be99a9b0324aa094c14039a48ffa89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:02Z,use_quota=True,user_id='c38f8b88ebac41919d78d431e4f2eb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2994d5f6-a0c1-430c-872f-94bf9c88c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2994d5f6-a0c1-430c-872f-94bf9c88c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f7830e-19ef-439c-af0c-0515a2868759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (3f4db6ee-4539-4da0-9a2a-6a88634e80f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:02 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1376dd-6255-41b1-a833-66ca66285755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d 1073741824" returned: 0 in 0.709s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1376dd-6255-41b1-a833-66ca66285755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-177466566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd84b82-98c7-46ec-a0fd-4870bc99c8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:02Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cb30f5-44f7-407f-b237-133cd17fc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cb30f5-44f7-407f-b237-133cd17fc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcfb282-3d56-46c2-a522-a36d03134a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcfb282-3d56-46c2-a522-a36d03134a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd84b82-98c7-46ec-a0fd-4870bc99c8c6', 'volume_name': 'volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634190ba-d779-4fa7-bc3e-981ef92c70a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634190ba-d779-4fa7-bc3e-981ef92c70a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2385051-ad97-4435-81f4-aa7068a31192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume ddd84b82-98c7-46ec-a0fd-4870bc99c8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6', 'volume_size': 1} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:02 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d Sep 07 11:00:02 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (057ac093-23a6-4190-ba56-ad4ba4e522be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728e6de8-403e-496d-b2c5-fdd963e00b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728e6de8-403e-496d-b2c5-fdd963e00b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672012564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b52b0c-ac0d-4589-a8f6-bb83b2662e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:03Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a0af80-0188-4c0c-b3b2-5c1329ae0aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a0af80-0188-4c0c-b3b2-5c1329ae0aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7687dd-8c9b-4193-8749-12d8495e7099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7687dd-8c9b-4193-8749-12d8495e7099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b52b0c-ac0d-4589-a8f6-bb83b2662e76', 'volume_name': 'volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57f80d8-c512-4d15-9b60-6f104c276e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57f80d8-c512-4d15-9b60-6f104c276e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d43f12-75dc-48a7-9705-7b4a3d046dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume d3b52b0c-ac0d-4589-a8f6-bb83b2662e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76', 'volume_size': 1} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d" returned: 0 in 0.460s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-177466566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd84b82-98c7-46ec-a0fd-4870bc99c8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:02Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Creating volume ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:03 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510ae364-14b2-49cc-acd7-ca72c4fe6ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da004f4-0951-46d9-bed2-20a3bd37995d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4869d9-cbb3-47dd-963c-48f6d63780e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 1073741824 Sep 07 11:00:03 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f7830e-19ef-439c-af0c-0515a2868759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fceca44f-da6a-430d-aba3-e086162dc72a', 'volume_name': 'volume-fceca44f-da6a-430d-aba3-e086162dc72a', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b99117-8514-400e-880c-b78ad0a170d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b99117-8514-400e-880c-b78ad0a170d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bceb3758-a7da-4aa6-998d-1fa68e917762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Volume fceca44f-da6a-430d-aba3-e086162dc72a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fceca44f-da6a-430d-aba3-e086162dc72a', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Trying to clone fceca44f-da6a-430d-aba3-e086162dc72a from image 705abe21-5cec-4130-9cb9-f60544709b95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 11:00:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume volume-7da004f4-0951-46d9-bed2-20a3bd37995d (7da004f4-0951-46d9-bed2-20a3bd37995d): created successfully Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4869d9-cbb3-47dd-963c-48f6d63780e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (a1981ebb-6c83-4015-bb00-839c5b2aad54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-388afe6e-824a-404c-9621-97f3da6270ad tempest-CreateVolumesFromSnapshotTest-261441019 None] Created volume successfully. Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (f9e6aa8b-767d-425b-9324-564800dfff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf2a05-6196-4dcf-bdcc-7e6352a264f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf2a05-6196-4dcf-bdcc-7e6352a264f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900539095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=509d56a2-853a-43b8-9664-5af820e696fe,host='devstack@QuobyteHD#QuobyteHD',id=1a2a0414-8bd4-49de-8096-059ebe54089d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:03Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334eb368-955a-4fd6-bbf9-39880629db21),volume_type_id=334eb368-955a-4fd6-bbf9-39880629db21)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7955c024-351c-4439-9ed0-4cbbed2dfaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7955c024-351c-4439-9ed0-4cbbed2dfaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4e2ced-d92d-4351-87a1-37ad8904aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4e2ced-d92d-4351-87a1-37ad8904aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2a0414-8bd4-49de-8096-059ebe54089d', 'volume_name': 'volume-1a2a0414-8bd4-49de-8096-059ebe54089d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98d8936-b15b-4dce-a339-8fa40e13bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98d8936-b15b-4dce-a339-8fa40e13bdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc46e3b-7588-44a3-8b21-32ccbe6bd838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Volume 1a2a0414-8bd4-49de-8096-059ebe54089d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2a0414-8bd4-49de-8096-059ebe54089d', 'volume_size': 1} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (63950597-9598-4c77-81d3-1c4c83e5fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca31d982-4693-47ed-a9bb-8dfad364de81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca31d982-4693-47ed-a9bb-8dfad364de81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1067567796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22257627-605f-4580-a779-336db56f7b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:04Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0626b3-62a6-4458-b93d-53fbba12b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0626b3-62a6-4458-b93d-53fbba12b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99ee3d2-7522-451c-935d-2b14bb6ee08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99ee3d2-7522-451c-935d-2b14bb6ee08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22257627-605f-4580-a779-336db56f7b83', 'volume_name': 'volume-22257627-605f-4580-a779-336db56f7b83', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5682ed7-895c-4606-bdd4-09453bf91cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5682ed7-895c-4606-bdd4-09453bf91cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a31fae1-af6a-4ae1-9161-049b3c079f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume 22257627-605f-4580-a779-336db56f7b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22257627-605f-4580-a779-336db56f7b83', 'volume_size': 1} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:04 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 11:00:04 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Image download 20.69 MB at 20.69 MB/s Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 1073741824" returned: 0 in 0.755s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (9b9a36e8-6096-482f-93d6-a47a753e0595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa850340-a4bb-40ac-aade-dd710c484f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f49963-3de7-48da-a955-2f29c0bcc0e1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa850340-a4bb-40ac-aade-dd710c484f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2846006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20c55da-9948-4908-9815-cb1e5679b849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:04Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb677048-716a-471f-8458-8c9de03804ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb677048-716a-471f-8458-8c9de03804ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 Sep 07 11:00:04 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07fde52-ae83-4b81-b824-cd1840c9f238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07fde52-ae83-4b81-b824-cd1840c9f238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20c55da-9948-4908-9815-cb1e5679b849', 'volume_name': 'volume-b20c55da-9948-4908-9815-cb1e5679b849', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3829aa-f49b-4544-93f5-04eff247320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3829aa-f49b-4544-93f5-04eff247320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e24d3e-8677-4286-b28b-1f72267a3735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume b20c55da-9948-4908-9815-cb1e5679b849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20c55da-9948-4908-9815-cb1e5679b849', 'volume_size': 1} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:04 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD Sep 07 11:00:04 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:04 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6" returned: 0 in 0.292s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672012564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b52b0c-ac0d-4589-a8f6-bb83b2662e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:03Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Creating volume d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:04 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:04 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 1073741824 Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2385051-ad97-4435-81f4-aa7068a31192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c290448-9727-45eb-ba00-739c04723f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:04 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 (ddd84b82-98c7-46ec-a0fd-4870bc99c8c6): created successfully Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c290448-9727-45eb-ba00-739c04723f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (3f4db6ee-4539-4da0-9a2a-6a88634e80f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8988877c-9742-406b-bb06-54ecf9590c16 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created volume successfully. Sep 07 11:00:04 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 is fetched for user c38f8b88ebac41919d78d431e4f2eb62. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c035467b-a7fe-4e94-aa2d-2a2abdc6f522]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:04 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD Sep 07 11:00:04 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:05 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 1073741824" returned: 0 in 0.560s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:05 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 Sep 07 11:00:05 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:05 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:05 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76" returned: 0 in 0.266s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=509d56a2-853a-43b8-9664-5af820e696fe,created_at=2026-09-07T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900539095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=509d56a2-853a-43b8-9664-5af820e696fe,host='devstack@QuobyteHD#QuobyteHD',id=1a2a0414-8bd4-49de-8096-059ebe54089d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:03Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334eb368-955a-4fd6-bbf9-39880629db21),volume_type_id=334eb368-955a-4fd6-bbf9-39880629db21)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Creating volume 1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:05 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d43f12-75dc-48a7-9705-7b4a3d046dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:05 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d 1073741824 Sep 07 11:00:05 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ab121e-6c76-4c36-9951-919a39fb634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 (d3b52b0c-ac0d-4589-a8f6-bb83b2662e76): created successfully Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ab121e-6c76-4c36-9951-919a39fb634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (057ac093-23a6-4190-ba56-ad4ba4e522be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d30c210b-e20e-46c0-b071-210094884b98 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created volume successfully. Sep 07 11:00:05 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d 1073741824" returned: 0 in 0.564s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:06 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d Sep 07 11:00:06 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:06 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d" returned: 0 in 0.303s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1067567796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22257627-605f-4580-a779-336db56f7b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:04Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Creating volume 22257627-605f-4580-a779-336db56f7b83 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:06 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc46e3b-7588-44a3-8b21-32ccbe6bd838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2a0414-8bd4-49de-8096-059ebe54089d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0733e30e-bb4e-46c4-b8fd-fee271ab842f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:06 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 1073741824 Sep 07 11:00:06 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:06 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Volume volume-1a2a0414-8bd4-49de-8096-059ebe54089d (1a2a0414-8bd4-49de-8096-059ebe54089d): created successfully Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0733e30e-bb4e-46c4-b8fd-fee271ab842f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (f9e6aa8b-767d-425b-9324-564800dfff0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:06 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f6d99087-033c-4285-badc-77ef463598e6 tempest-GroupSnapshotsTest-2075329994 None] Created volume successfully. Sep 07 11:00:06 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 1073741824" returned: 0 in 0.584s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:07 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 Sep 07 11:00:07 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0401ed14-2f06-4b21-a6ef-dcba7c0242c8 tempest-GroupSnapshotsTest-2075329994 None] Update group completed successfully. Sep 07 11:00:07 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83" returned: 0 in 0.297s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2846006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20c55da-9948-4908-9815-cb1e5679b849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f283714f715940d0aba62b0d3fc0ea68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:04Z,use_quota=True,user_id='288af9cae02b4317ae34bd244925b6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Creating volume b20c55da-9948-4908-9815-cb1e5679b849 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:07 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a31fae1-af6a-4ae1-9161-049b3c079f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22257627-605f-4580-a779-336db56f7b83', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5fb19d-8546-4683-ad47-74bed9c027ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:07 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 1073741824 Sep 07 11:00:07 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:07 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume volume-22257627-605f-4580-a779-336db56f7b83 (22257627-605f-4580-a779-336db56f7b83): created successfully Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5fb19d-8546-4683-ad47-74bed9c027ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (63950597-9598-4c77-81d3-1c4c83e5fca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-69c0afe4-88f9-420b-a6a8-5bcf250d9b65 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created volume successfully. Sep 07 11:00:07 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 1073741824" returned: 0 in 0.465s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:07 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 Sep 07 11:00:07 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:08 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849" returned: 0 in 0.330s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.940s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-368344484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fceca44f-da6a-430d-aba3-e086162dc72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43be99a9b0324aa094c14039a48ffa89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:02Z,use_quota=True,user_id='c38f8b88ebac41919d78d431e4f2eb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Creating volume fceca44f-da6a-430d-aba3-e086162dc72a {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:08 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:08 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a 1073741824 Sep 07 11:00:08 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e24d3e-8677-4286-b28b-1f72267a3735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20c55da-9948-4908-9815-cb1e5679b849', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87c97b9-80f0-4ca2-afb8-7479396ecc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:08 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Volume volume-b20c55da-9948-4908-9815-cb1e5679b849 (b20c55da-9948-4908-9815-cb1e5679b849): created successfully Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87c97b9-80f0-4ca2-afb8-7479396ecc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Flow 'volume_create_manager' (9b9a36e8-6096-482f-93d6-a47a753e0595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:08 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5fe59264-e569-4a8e-98bc-cf6711020e86 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created volume successfully. Sep 07 11:00:08 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7d7458eb-5cb1-479b-a7f0-7bbcc0c2bee2 tempest-GroupSnapshotsTest-2075329994 None] Update group completed successfully. Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-b20c55da-9948-4908-9815-cb1e5679b849-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-b20c55da-9948-4908-9815-cb1e5679b849-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-b20c55da-9948-4908-9815-cb1e5679b849" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-b20c55da-9948-4908-9815-cb1e5679b849" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[742fff59-5bb8-4e04-82d6-f42c33b71142]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:08 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a 1073741824" returned: 0 in 0.595s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:08 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a Sep 07 11:00:08 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:08 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 Sep 07 11:00:08 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:09 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a" returned: 0 in 0.264s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Attempting download of 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume fceca44f-da6a-430d-aba3-e086162dc72a. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 11:00:09 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849" returned: 0 in 0.399s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d9e462-95c2-45de-8de5-91c7780a4264]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_v01h5hbr {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:09 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849 Sep 07 11:00:09 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:09 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_v01h5hbr Sep 07 11:00:09 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:09 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:09 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ae3107a6-b78f-487c-9a00-3089401fce01 tempest-GroupSnapshotsTest-2075329994 None] Update group completed successfully. Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b20c55da-9948-4908-9815-cb1e5679b849" returned: 0 in 0.343s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-b20c55da-9948-4908-9815-cb1e5679b849" released by "delete_volume" :: held 0.791s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created reservations ['946ef533-6e6d-4c35-aa40-6250b55ca0ae', '46d69507-e2e5-4af0-ae07-3b9efb872c79', '68a97b98-4d61-443f-bbc6-7587699e7f24', 'b9d8da4e-1313-484d-8f95-48900fe93783'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:09 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_v01h5hbr" returned: 0 in 0.429s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_v01h5hbr {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:09 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_v01h5hbr Sep 07 11:00:09 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:09 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:09 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-22257627-605f-4580-a779-336db56f7b83-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-22257627-605f-4580-a779-336db56f7b83-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-22257627-605f-4580-a779-336db56f7b83" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-22257627-605f-4580-a779-336db56f7b83" acquired by "delete_volume" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:09 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_v01h5hbr" returned: 1 in 0.429s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_v01h5hbr' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07f05bf-0b4d-4168-a265-ec60f077498e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cdcd40-fe6a-4c3f-b28f-710c28d6905e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:10 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.414s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Deleted volume successfully. Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5991e03c-0d55-4e19-b62e-dfb211606c68 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-b20c55da-9948-4908-9815-cb1e5679b849-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:10 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD Sep 07 11:00:10 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:10 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 Sep 07 11:00:10 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:10 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] 705abe21-5cec-4130-9cb9-f60544709b95 was qcow2, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:10 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83" returned: 0 in 0.419s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:10 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a Sep 07 11:00:10 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:10 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83 Sep 07 11:00:10 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:10 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:10 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b53383e4-669e-460c-8d86-6139b3476232 tempest-GroupSnapshotsTest-2075329994 None] Update group completed successfully. Sep 07 11:00:10 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-22257627-605f-4580-a779-336db56f7b83" returned: 0 in 0.313s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-22257627-605f-4580-a779-336db56f7b83" released by "delete_volume" :: held 0.801s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Created reservations ['a27c7f29-2aa1-434a-b584-20b48ea1aec3', 'e982e1fb-2418-4587-8c9b-f4645f376c02', '71d019f2-3c08-45bf-b289-4c090a047861', 'f2f660db-0615-44f7-913b-a2c135d329ed'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:10 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.324s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:11 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:11 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd0d20-abdc-4a1a-bd1f-6ad00c1fb937]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:11 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.500s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Deleted volume successfully. Sep 07 11:00:11 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 Sep 07 11:00:11 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1228abe2-5e1a-4cab-864a-14d7813e7daa tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-22257627-605f-4580-a779-336db56f7b83-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:11 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76" returned: 0 in 0.491s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:11 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76 Sep 07 11:00:11 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:12 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76" returned: 0 in 0.358s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76" released by "delete_volume" :: held 0.924s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] GroupSnapshot ef00a8dd-5896-42f4-8d0c-6bf724b850e5: creating. Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Group snapshot ef00a8dd-5896-42f4-8d0c-6bf724b850e5: creating. {{(pid=87271) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created reservations ['c87e05a4-a170-4611-b8c4-fd3d5ded517c', '822d0bad-fb2b-4ea6-ad05-2e55ddaed0c5', 'f675cfae-80c5-4f73-870f-e70914d98453', 'bef17358-d502-45d3-8726-a5977f12df5d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Creating offline snapshot d23420ce-c051-41aa-bdbe-045d9bbea42a of volume 2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedd2b0c-3229-486c-9c4e-ab74cdb4c7a1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:12 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:12 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:12 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 Sep 07 11:00:12 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:12 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a" returned: 0 in 2.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_ep_xtwqidevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:00:12 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Converted 112.00 MB image at 47.40 MB/s Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:12 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a 1G Sep 07 11:00:12 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:12 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.305s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Deleted volume successfully. Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1ea78cb-5d7a-4670-9ed6-3959ec86ccd1 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-d3b52b0c-ac0d-4589-a8f6-bb83b2662e76-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:12 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4" returned: 0 in 0.504s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:12 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a 1G Sep 07 11:00:13 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:13 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a 1G" returned: 0 in 0.423s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Downloaded image 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume fceca44f-da6a-430d-aba3-e086162dc72a successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 for user c38f8b88ebac41919d78d431e4f2eb62 is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Marking volume fceca44f-da6a-430d-aba3-e086162dc72a as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Copying metadata from image 705abe21-5cec-4130-9cb9-f60544709b95 to fceca44f-da6a-430d-aba3-e086162dc72a. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Creating volume glance metadata for volume fceca44f-da6a-430d-aba3-e086162dc72a backed by image 705abe21-5cec-4130-9cb9-f60544709b95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bceb3758-a7da-4aa6-998d-1fa68e917762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fceca44f-da6a-430d-aba3-e086162dc72a', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c61052-c127-47cb-aff4-d5d71a9dba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:13 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Volume volume-fceca44f-da6a-430d-aba3-e086162dc72a (fceca44f-da6a-430d-aba3-e086162dc72a): created successfully Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c61052-c127-47cb-aff4-d5d71a9dba53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Flow 'volume_create_manager' (71e19595-1eda-4df4-9691-249949ecb253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-374db953-f93a-4e7e-95e2-ca3e84751333 tempest-TestShelveInstance-1948031024 None] Created volume successfully. Sep 07 11:00:13 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a 1G" returned: 0 in 0.545s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:13 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a Sep 07 11:00:13 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8813724-a223-46f2-b181-2531d90cbe0c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:13 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 Sep 07 11:00:13 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:13 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a" returned: 0 in 0.367s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:13 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:00:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:13 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a Sep 07 11:00:13 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:14 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6" returned: 0 in 0.434s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:14 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:14 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6 Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a" returned: 0 in 0.313s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:14 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:14 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.info Sep 07 11:00:14 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:14 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6" returned: 0 in 0.382s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6" released by "delete_volume" :: held 0.866s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created reservations ['1f6a08c7-8347-42b2-94f6-43ba7b447dc5', 'f8e2dfb7-04c9-48a6-9a8a-1bd0e3fb4ca2', 'f700d827-048e-4782-95ae-6c29603e1d2e', 'cbc5d359-4dcb-4dab-af0d-fa4d1048a5af'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:14 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.info" returned: 0 in 0.418s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:14 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:14 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.info Sep 07 11:00:14 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:14 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:14 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-7da004f4-0951-46d9-bed2-20a3bd37995d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-7da004f4-0951-46d9-bed2-20a3bd37995d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-7da004f4-0951-46d9-bed2-20a3bd37995d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-7da004f4-0951-46d9-bed2-20a3bd37995d" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e417c3-e89f-4da7-9bf4-4448ad85c860]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:15 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.info" returned: 0 in 0.410s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.721s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Creating offline snapshot e82a265b-9605-49af-8560-6cb90ea873cb of volume 1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[928d5d75-c596-446c-b460-49ea4a7dc0ae]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:15 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.418s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Deleted volume successfully. Sep 07 11:00:15 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d Sep 07 11:00:15 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-babdc83d-4b28-4bae-9654-f5a660ed8745 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-ddd84b82-98c7-46ec-a0fd-4870bc99c8c6-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:15 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d Sep 07 11:00:15 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:15 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d" returned: 0 in 0.553s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:15 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d Sep 07 11:00:15 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:15 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d" returned: 0 in 0.500s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:15 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb 1G Sep 07 11:00:15 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:15 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7da004f4-0951-46d9-bed2-20a3bd37995d" returned: 0 in 0.344s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-7da004f4-0951-46d9-bed2-20a3bd37995d" released by "delete_volume" :: held 0.955s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Created reservations ['a467dbb6-6667-40dd-bf0e-9f9b479fc31a', '255ea7d0-9120-4211-bc51-bbde63f11e05', '49669f64-1296-4be1-aca7-9c4997ad459f', '42b52119-a782-47ac-8268-44cdceff6c10'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:16 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:16 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:16 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb 1G" returned: 0 in 0.635s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2a0414-8bd4-49de-8096-059ebe54089d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:16 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2a0414-8bd4-49de-8096-059ebe54089d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb Sep 07 11:00:16 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:16 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.317s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Deleted volume successfully. Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cc24edce-4ffa-4867-82f7-d4df19f229fd tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-7da004f4-0951-46d9-bed2-20a3bd37995d-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:16 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2a0414-8bd4-49de-8096-059ebe54089d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb" returned: 0 in 0.434s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:16 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:00:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:16 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb Sep 07 11:00:16 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:17 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb" returned: 0 in 0.296s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:17 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.info Sep 07 11:00:17 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-8be0f4ad-1050-408c-8354-a6a942487326-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-8be0f4ad-1050-408c-8354-a6a942487326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-e738f397-b887-44e5-83c5-d4bbc86696f0" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-e738f397-b887-44e5-83c5-d4bbc86696f0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-8be0f4ad-1050-408c-8354-a6a942487326" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-8be0f4ad-1050-408c-8354-a6a942487326" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Deleting offline snapshot 8be0f4ad-1050-408c-8354-a6a942487326 of volume e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] snapshot_file for this snap is: volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21a675-8f3c-4f95-bb4e-b932a80b87c4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:17 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.info" returned: 0 in 0.421s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:17 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:17 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 Sep 07 11:00:17 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:17 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.info Sep 07 11:00:17 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:17 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.info" returned: 0 in 0.362s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:17 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326" returned: 0 in 0.568s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e738f397-b887-44e5-83c5-d4bbc86696f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ad931-c089-4e14-9e77-6cddb37bf365]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-92e3ea1e-fab7-4dfc-81a6-700c42e93c5b tempest-GroupSnapshotsTest-2075329994 None] group_snapshot ef00a8dd-5896-42f4-8d0c-6bf724b850e5: created successfully Sep 07 11:00:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7ab23f6b-440b-4cc5-b5c2-1f8cee393e5b req-8ec92024-a43b-4a6f-94f4-f5f3bdc6dfaa tempest-TestShelveInstance-1948031024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7ab23f6b-440b-4cc5-b5c2-1f8cee393e5b req-8ec92024-a43b-4a6f-94f4-f5f3bdc6dfaa tempest-TestShelveInstance-1948031024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:18 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 Sep 07 11:00:18 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-7ab23f6b-440b-4cc5-b5c2-1f8cee393e5b req-8ec92024-a43b-4a6f-94f4-f5f3bdc6dfaa tempest-TestShelveInstance-1948031024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-7ab23f6b-440b-4cc5-b5c2-1f8cee393e5b req-8ec92024-a43b-4a6f-94f4-f5f3bdc6dfaa tempest-TestShelveInstance-1948031024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-fceca44f-da6a-430d-aba3-e086162dc72a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edf7e4b5-66ed-4838-855d-eed30108b04f', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 11:00:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-7ab23f6b-440b-4cc5-b5c2-1f8cee393e5b req-8ec92024-a43b-4a6f-94f4-f5f3bdc6dfaa tempest-TestShelveInstance-1948031024 None] attachment_update completed successfully. Sep 07 11:00:18 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0" returned: 0 in 0.585s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:18 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 Sep 07 11:00:18 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] group_snapshot ef00a8dd-5896-42f4-8d0c-6bf724b850e5: deleting Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=151,cinder:UPDATE=149,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] group_snapshot ef00a8dd-5896-42f4-8d0c-6bf724b850e5: deleting {{(pid=87271) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 11:00:19 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-2653371d-a02d-47b9-ae24-8b7fcded2fc4" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326" returned: 0 in 0.607s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-2653371d-a02d-47b9-ae24-8b7fcded2fc4" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-d23420ce-c051-41aa-bdbe-045d9bbea42a" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-d23420ce-c051-41aa-bdbe-045d9bbea42a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:19 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326 Sep 07 11:00:19 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Deleting offline snapshot d23420ce-c051-41aa-bdbe-045d9bbea42a of volume 2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] snapshot_file for this snap is: volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f08748-92d6-425f-8dc8-5e7899ddad07]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:19 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a Sep 07 11:00:19 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:19 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0.8be0f4ad-1050-408c-8354-a6a942487326" returned: 0 in 0.453s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-8be0f4ad-1050-408c-8354-a6a942487326" released by "_delete_snapshot" :: held 2.379s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-e738f397-b887-44e5-83c5-d4bbc86696f0" released by "delete_snapshot" :: held 2.432s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created reservations ['4f879dc4-ce66-4474-be0c-811b29476679', 'e2c6cc3a-f607-4b7c-aed7-34d17a3bc4cc', '4f1d0adb-2e77-4060-93ee-8c3d3c89e6c6', '3bc0df23-cddc-4bcb-a5c6-e2cea0ffaea6'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:19 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a" returned: 0 in 0.509s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b6e805-f2bc-4d1f-83b4-f140413eab19]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Delete snapshot completed successfully. Sep 07 11:00:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4a935969-30aa-4e5c-84fe-9ab8c296d2a4 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-8be0f4ad-1050-408c-8354-a6a942487326-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:19 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 Sep 07 11:00:19 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:20 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4" returned: 0 in 0.490s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:20 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a Sep 07 11:00:20 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-e738f397-b887-44e5-83c5-d4bbc86696f0-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-e738f397-b887-44e5-83c5-d4bbc86696f0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "cinder-quobyte-e738f397-b887-44e5-83c5-d4bbc86696f0" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-e738f397-b887-44e5-83c5-d4bbc86696f0" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4ab9a0-2466-4ccc-bb7c-a0cbbecbd525]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Flow 'volume_create_manager' (bbdd1d2d-d1a4-407e-87bd-a90132c1497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9451c9-7eb9-4948-8968-89df6f3b6779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9451c9-7eb9-4948-8968-89df6f3b6779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0769dc62-7e3b-43bd-bc2a-adb8c02f8a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebd1fe0bd2a47d79de355df723338b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:21Z,use_quota=True,user_id='5c52370850f54acead89ff73b381ff28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66f6bde-9f4b-4a0f-9355-24da6531528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66f6bde-9f4b-4a0f-9355-24da6531528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ed3890-9f8e-438d-a40a-dc55978517d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 11:00:20 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:20 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 Sep 07 11:00:20 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a" returned: 0 in 0.616s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:20 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a Sep 07 11:00:20 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:21 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ed3890-9f8e-438d-a40a-dc55978517d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0769dc62-7e3b-43bd-bc2a-adb8c02f8a37', 'volume_name': 'volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37', 'volume_size': 1, 'image_id': '4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5bfa6a99e25be60667b3ce85dd68227', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ebd1fe0bd2a47d79de355df723338b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdf2aa54d8ba21ae1f5990e74dcaeb62f7f54247382bc64e094659f68766f04b65058fa64a6cf8a7d13dca68a4db40a1b072a8f0da51f1a565509636135beb25', 'id': '4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'created_at': datetime.datetime(2026, 9, 7, 9, 0, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 0, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65/file', 'properties': {}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b1ad4d-50dd-454e-b6e4-b7f256fe55d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b1ad4d-50dd-454e-b6e4-b7f256fe55d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60680ba3-78ee-4383-bd04-101762a898f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Volume 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37', 'volume_size': 1, 'image_id': '4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5bfa6a99e25be60667b3ce85dd68227', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ebd1fe0bd2a47d79de355df723338b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdf2aa54d8ba21ae1f5990e74dcaeb62f7f54247382bc64e094659f68766f04b65058fa64a6cf8a7d13dca68a4db40a1b072a8f0da51f1a565509636135beb25', 'id': '4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'created_at': datetime.datetime(2026, 9, 7, 9, 0, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 0, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65/file', 'properties': {}}, 'image_service': } Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Trying to clone 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 from image 4af7d17d-571a-4e77-ba24-8c79eeba2c65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0" returned: 0 in 0.494s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:21 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:21 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0 Sep 07 11:00:21 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4.d23420ce-c051-41aa-bdbe-045d9bbea42a" returned: 0 in 0.347s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-d23420ce-c051-41aa-bdbe-045d9bbea42a" released by "_delete_snapshot" :: held 2.132s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-2653371d-a02d-47b9-ae24-8b7fcded2fc4" released by "delete_snapshot" :: held 2.172s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-1a2a0414-8bd4-49de-8096-059ebe54089d" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-1a2a0414-8bd4-49de-8096-059ebe54089d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-e82a265b-9605-49af-8560-6cb90ea873cb" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-e82a265b-9605-49af-8560-6cb90ea873cb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Deleting offline snapshot e82a265b-9605-49af-8560-6cb90ea873cb of volume 1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] snapshot_file for this snap is: volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 11:00:21 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Image download 0.00 MB at 0.00 MB/s Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[979d0e4a-444a-498b-a460-b7678af6072f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[965d27bb-5509-44c7-b39f-d7e78d76b169]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:21 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e738f397-b887-44e5-83c5-d4bbc86696f0" returned: 0 in 0.426s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-quobyte-e738f397-b887-44e5-83c5-d4bbc86696f0" released by "delete_volume" :: held 1.034s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:21 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb Sep 07 11:00:21 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=145,cinder:SELECT=155,cinder:INSERT=39,cinder:DELETE=9 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:00:21 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD Sep 07 11:00:21 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:21 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Created reservations ['ac81ce96-d889-42b5-aef5-7fdfdf2fbc40', '1a642a2f-74f5-4ac8-98b1-9c24cbcf330b', '49da9d58-1974-42ca-9071-fc198a55b07f', 'c2f5abb5-d75e-483d-8513-5a523aaf3b12'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:22 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:22 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:22 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:22 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb" returned: 0 in 1.073s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a2a0414-8bd4-49de-8096-059ebe54089d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c095c951-02c3-47f2-b472-faa6178fa2d4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:22 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD Sep 07 11:00:22 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:22 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.508s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Deleted volume successfully. Sep 07 11:00:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ce41c072-f533-460a-a00a-898aeeb1c799 tempest-CreateVolumesFromSnapshotTest-261441019 None] Lock "cinder-e738f397-b887-44e5-83c5-d4bbc86696f0-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:22 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d Sep 07 11:00:22 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:23 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD" returned: 1 in 0.693s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Temporary image 4af7d17d-571a-4e77-ba24-8c79eeba2c65 is fetched for user 5c52370850f54acead89ff73b381ff28. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9fd7fa-e6cb-46b6-ad60-c62d430ed3fa]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:23 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d" returned: 0 in 0.729s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:23 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb Sep 07 11:00:23 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:23 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD Sep 07 11:00:23 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:23 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:23 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD Sep 07 11:00:23 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:23 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb" returned: 0 in 0.617s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:23 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb Sep 07 11:00:23 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:24 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD" returned: 1 in 0.469s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0769dc62-7e3b-43bd-bc2a-adb8c02f8a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebd1fe0bd2a47d79de355df723338b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:21Z,use_quota=True,user_id='5c52370850f54acead89ff73b381ff28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Creating volume 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:24 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 1073741824 Sep 07 11:00:24 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:24 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d.e82a265b-9605-49af-8560-6cb90ea873cb" returned: 0 in 0.511s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-e82a265b-9605-49af-8560-6cb90ea873cb" released by "_delete_snapshot" :: held 3.138s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-1a2a0414-8bd4-49de-8096-059ebe54089d" released by "delete_snapshot" :: held 3.180s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:24 devstack cinder-volume[87271]: WARNING cinder.quota [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-437263221 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-437263221, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:00:24 devstack cinder-volume[87271]: WARNING cinder.quota [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-437263221 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-437263221, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:00:24 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['685429d0-ad86-416e-aa8e-ae799131ac59', '373aec55-8d54-4b70-a483-e970df88e784', '734ef07d-4e58-4996-943c-e62ed5df3c90', '2cc2969e-2647-423c-932e-fc39c3f46c64'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['df032c9e-c36a-4ded-8e4e-611504fba926', '0546f9e2-1aaf-444f-a073-ee12a98c0963', 'cee3b4a9-d0ba-4895-9361-4ed5940950ee', '27b6c96a-c193-4837-a59a-4b7398c89023'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6faa00d7-83a9-4846-8bde-e2b3c63bce24 tempest-GroupSnapshotsTest-2075329994 None] group_snapshot ef00a8dd-5896-42f4-8d0c-6bf724b850e5: deleted successfully Sep 07 11:00:25 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 1073741824" returned: 0 in 0.993s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:25 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 Sep 07 11:00:25 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:25 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37" returned: 0 in 0.311s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Attempting download of 4af7d17d-571a-4e77-ba24-8c79eeba2c65 ((None, [{'url': 'file:///opt/stack/data/glance/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'metadata': {}}])) to volume 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[493347d6-8a99-4e1c-93af-5027323233f1]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4af7d17d-571a-4e77-ba24-8c79eeba2c65_n03x_hw5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:25 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4af7d17d-571a-4e77-ba24-8c79eeba2c65_n03x_hw5 Sep 07 11:00:25 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:26 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4af7d17d-571a-4e77-ba24-8c79eeba2c65_n03x_hw5" returned: 0 in 0.522s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4af7d17d-571a-4e77-ba24-8c79eeba2c65_n03x_hw5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-1a2a0414-8bd4-49de-8096-059ebe54089d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-1a2a0414-8bd4-49de-8096-059ebe54089d" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:26 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4af7d17d-571a-4e77-ba24-8c79eeba2c65_n03x_hw5 Sep 07 11:00:26 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4308787e-1379-4d66-aa65-6e6bdaab1c41]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:26 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d Sep 07 11:00:26 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:26 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4af7d17d-571a-4e77-ba24-8c79eeba2c65_n03x_hw5" returned: 1 in 0.685s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4af7d17d-571a-4e77-ba24-8c79eeba2c65_n03x_hw5' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda7a27e-b960-4574-912b-559f1961a17d]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:27 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d" returned: 0 in 0.548s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:27 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD Sep 07 11:00:27 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:27 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d Sep 07 11:00:27 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:27 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1a2a0414-8bd4-49de-8096-059ebe54089d" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-1a2a0414-8bd4-49de-8096-059ebe54089d" released by "delete_volume" :: held 1.065s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-2653371d-a02d-47b9-ae24-8b7fcded2fc4" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-2653371d-a02d-47b9-ae24-8b7fcded2fc4" acquired by "delete_volume" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:27 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec50ae30-8754-4d94-985f-936832e1b768]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:27 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD Sep 07 11:00:27 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 Sep 07 11:00:27 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:27 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:28 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD" returned: 1 in 0.509s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] 4af7d17d-571a-4e77-ba24-8c79eeba2c65 was raw, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:28 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 Sep 07 11:00:28 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:28 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4" returned: 0 in 0.785s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:28 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4 Sep 07 11:00:28 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (568c08ee-4ca6-4058-aa6e-d76877d70739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4e2fde-68b6-4e2c-906f-aa72594f9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4e2fde-68b6-4e2c-906f-aa72594f9d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1171801703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b1244e-d89f-491f-b269-6cee808c75ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:28Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffdcaec-8e55-49d8-ba9b-ca1a15e31760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffdcaec-8e55-49d8-ba9b-ca1a15e31760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08dda9c-0c70-4ce4-909f-64edac8a6554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08dda9c-0c70-4ce4-909f-64edac8a6554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b1244e-d89f-491f-b269-6cee808c75ec', 'volume_name': 'volume-f1b1244e-d89f-491f-b269-6cee808c75ec', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d222802f-f85a-499b-b122-81906bd65a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d222802f-f85a-499b-b122-81906bd65a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5021cedf-4cd8-4147-aca5-991429a8fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:28 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume f1b1244e-d89f-491f-b269-6cee808c75ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b1244e-d89f-491f-b269-6cee808c75ec', 'volume_size': 1} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1171801703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b1244e-d89f-491f-b269-6cee808c75ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:28Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Creating volume f1b1244e-d89f-491f-b269-6cee808c75ec {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:28 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:28 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec 1073741824 Sep 07 11:00:28 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:28 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2653371d-a02d-47b9-ae24-8b7fcded2fc4" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-2653371d-a02d-47b9-ae24-8b7fcded2fc4" released by "delete_volume" :: held 1.382s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:29 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37" returned: 0 in 0.980s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4af7d17d-571a-4e77-ba24-8c79eeba2c65_hy6gn5apdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:00:29 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['a3470a19-c78d-4b8d-a9aa-c3ecf16b9a1b'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:29 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 1G Sep 07 11:00:29 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:29 devstack cinder-volume[87271]: WARNING cinder.quota [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-437263221 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-437263221, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['bf75ac68-2e7b-4ecb-988f-4d33f22fe35b', '8e1a10ca-9f57-487b-b726-09009387b6e3', '298dace0-b8fd-4d7d-a712-b064ff21fb87', 'f899da83-4fb8-45b5-95b1-82202180f3a0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['045025cd-6fcf-49dd-9b24-0a5c681102e8', '7001c60e-a3f8-47e6-bec9-ceb5bdfae01a', '92da843a-6437-4dff-8ef9-8938e155b697', '9693e842-cebd-42bd-8e19-e623a829e5e2'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:29 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec 1073741824" returned: 0 in 0.879s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:29 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 1G" returned: 0 in 0.614s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Downloaded image 4af7d17d-571a-4e77-ba24-8c79eeba2c65 ((None, [{'url': 'file:///opt/stack/data/glance/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'metadata': {}}])) to volume 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Temporary image 4af7d17d-571a-4e77-ba24-8c79eeba2c65 for user 5c52370850f54acead89ff73b381ff28 is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Marking volume 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 11:00:29 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec Sep 07 11:00:29 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Copying metadata from image 4af7d17d-571a-4e77-ba24-8c79eeba2c65 to 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Creating volume glance metadata for volume 0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 backed by image 4af7d17d-571a-4e77-ba24-8c79eeba2c65 with: {'image_id': '4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b5bfa6a99e25be60667b3ce85dd68227', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:29 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:29 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60680ba3-78ee-4383-bd04-101762a898f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37', 'volume_size': 1, 'image_id': '4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5bfa6a99e25be60667b3ce85dd68227', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ebd1fe0bd2a47d79de355df723338b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdf2aa54d8ba21ae1f5990e74dcaeb62f7f54247382bc64e094659f68766f04b65058fa64a6cf8a7d13dca68a4db40a1b072a8f0da51f1a565509636135beb25', 'id': '4af7d17d-571a-4e77-ba24-8c79eeba2c65', 'created_at': datetime.datetime(2026, 9, 7, 9, 0, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 0, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4af7d17d-571a-4e77-ba24-8c79eeba2c65/file', 'properties': {}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:29 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d3246c-b5bf-462c-97c9-70f9b7048e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:30 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Volume volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 (0769dc62-7e3b-43bd-bc2a-adb8c02f8a37): created successfully Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d3246c-b5bf-462c-97c9-70f9b7048e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Flow 'volume_create_manager' (bbdd1d2d-d1a4-407e-87bd-a90132c1497c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:30 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:30 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6daf451b-73cf-4ef5-9f82-b130af26ef62 tempest-VolumeImageDependencyTests-24403612 None] Created volume successfully. Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec" returned: 0 in 0.365s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5021cedf-4cd8-4147-aca5-991429a8fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b1244e-d89f-491f-b269-6cee808c75ec', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b43788a-da94-4209-a334-f3887d699885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:30 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume volume-f1b1244e-d89f-491f-b269-6cee808c75ec (f1b1244e-d89f-491f-b269-6cee808c75ec): created successfully Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b43788a-da94-4209-a334-f3887d699885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (568c08ee-4ca6-4058-aa6e-d76877d70739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:30 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e2298214-545e-4ecc-a447-f1ad5f0cf35d tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created volume successfully. Sep 07 11:00:30 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:30 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:30 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0edaaafe-db3f-474d-b9ec-39758b79815b tempest-GroupSnapshotsTest-2075329994 None] Delete group completed successfully. Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Acquiring lock "cinder-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Lock "cinder-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Acquiring lock "cinder-quobyte-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Lock "cinder-quobyte-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af1dfb-2ece-4169-85d0-368599a2e2d0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:31 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 Sep 07 11:00:31 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (967ac894-abdb-4c9d-823e-4b10d704146d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29adc96-4c8f-48d1-80e6-70e1859b9f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29adc96-4c8f-48d1-80e6-70e1859b9f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289320025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cdf662-0002-4347-88c3-ac0433b37f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:31Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1d04c1-695f-4a79-a2fb-67896f10f460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1d04c1-695f-4a79-a2fb-67896f10f460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82410545-dda7-4bb6-8c7e-6792638ed984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82410545-dda7-4bb6-8c7e-6792638ed984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79cdf662-0002-4347-88c3-ac0433b37f97', 'volume_name': 'volume-79cdf662-0002-4347-88c3-ac0433b37f97', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d6ca4f-1f15-4998-8861-f36945afd5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d6ca4f-1f15-4998-8861-f36945afd5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07e5bd0-f7cf-4604-ba1e-1f2191750c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume 79cdf662-0002-4347-88c3-ac0433b37f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79cdf662-0002-4347-88c3-ac0433b37f97', 'volume_size': 1} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289320025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cdf662-0002-4347-88c3-ac0433b37f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:31Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Creating volume 79cdf662-0002-4347-88c3-ac0433b37f97 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:31 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:31 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 1073741824 Sep 07 11:00:31 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:32 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37" returned: 0 in 0.974s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:32 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37 Sep 07 11:00:32 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f9cb96d6-7424-489e-a2c7-9afec9589d31 tempest-GroupSnapshotsTest-2075329994 None] Group tempest-GroupSnapshotsTest-Group-567607566: creating Sep 07 11:00:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f9cb96d6-7424-489e-a2c7-9afec9589d31 tempest-GroupSnapshotsTest-2075329994 None] Group tempest-GroupSnapshotsTest-Group-567607566: created successfully Sep 07 11:00:32 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f9cb96d6-7424-489e-a2c7-9afec9589d31 tempest-GroupSnapshotsTest-2075329994 None] Create group completed successfully. Sep 07 11:00:32 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (563e7685-aad2-4ae8-8c18-92b6374b0e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e5359c-ace1-44fd-9f92-efdc298767d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 1073741824" returned: 0 in 0.843s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e5359c-ace1-44fd-9f92-efdc298767d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511608411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4150531-8812-4af5-b822-e0dcf889e209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:32Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc43106b-25df-4252-99d6-96a88541fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc43106b-25df-4252-99d6-96a88541fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f104021e-7258-4ea8-8fe2-abe25c12d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:32 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f104021e-7258-4ea8-8fe2-abe25c12d33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4150531-8812-4af5-b822-e0dcf889e209', 'volume_name': 'volume-e4150531-8812-4af5-b822-e0dcf889e209', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc228a55-caef-4032-888b-655ef63395b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc228a55-caef-4032-888b-655ef63395b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9070d28c-355b-49e9-b70e-25285da96698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:32 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume e4150531-8812-4af5-b822-e0dcf889e209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4150531-8812-4af5-b822-e0dcf889e209', 'volume_size': 1} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37" returned: 0 in 0.583s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Lock "cinder-quobyte-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37" released by "delete_volume" :: held 1.619s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:32 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 Sep 07 11:00:32 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:32 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Created reservations ['a3cb52c1-a9c1-44cb-bb58-4bd87e475000', '5869198b-fae7-4102-b7a3-144f67ebd072', '3e6862bc-bf29-4f63-81b8-46628b842927', '1757bdab-e5bb-4b74-ad5b-ef134f33d582'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (053b3047-4b75-408b-999e-9468b76fcedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:33 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d61559-14a0-411b-8173-25d1330b5279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97" returned: 0 in 0.576s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:33 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:33 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511608411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4150531-8812-4af5-b822-e0dcf889e209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:32Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Creating volume e4150531-8812-4af5-b822-e0dcf889e209 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:33 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:33 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 1073741824 Sep 07 11:00:33 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d61559-14a0-411b-8173-25d1330b5279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-97091769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58426e9f-c127-4c37-aba3-a220d8ad6bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:33Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16a6432-ff3b-4ad0-a8f5-6bc5ba617ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16a6432-ff3b-4ad0-a8f5-6bc5ba617ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd706fa-833b-4bc7-b97f-ea2c5c8f46e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd706fa-833b-4bc7-b97f-ea2c5c8f46e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58426e9f-c127-4c37-aba3-a220d8ad6bff', 'volume_name': 'volume-58426e9f-c127-4c37-aba3-a220d8ad6bff', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1807d02-5faf-46ba-b3a7-48915dfb3194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1807d02-5faf-46ba-b3a7-48915dfb3194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174a9b18-eae3-4501-b1d7-cf50506a3e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:33 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume 58426e9f-c127-4c37-aba3-a220d8ad6bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58426e9f-c127-4c37-aba3-a220d8ad6bff', 'volume_size': 1} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07e5bd0-f7cf-4604-ba1e-1f2191750c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79cdf662-0002-4347-88c3-ac0433b37f97', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90be45a2-ba09-4002-8e77-096059aaaa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:33 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume volume-79cdf662-0002-4347-88c3-ac0433b37f97 (79cdf662-0002-4347-88c3-ac0433b37f97): created successfully Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90be45a2-ba09-4002-8e77-096059aaaa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (967ac894-abdb-4c9d-823e-4b10d704146d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c2226b35-c73b-43c6-8bae-1cd11e959103 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created volume successfully. Sep 07 11:00:33 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.664s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:33 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Deleted volume successfully. Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1542814-6511-4b20-9bcf-4d7aff0327b0 tempest-VolumeImageDependencyTests-24403612 None] Lock "cinder-0769dc62-7e3b-43bd-bc2a-adb8c02f8a37-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (de83b975-2c95-4938-8ca5-ec0f48fba1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de17d37-d903-49f1-96aa-dfe9bbd30dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de17d37-d903-49f1-96aa-dfe9bbd30dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1359223780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:34Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823fe300-8a53-4d4d-89aa-b357ed9a7510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823fe300-8a53-4d4d-89aa-b357ed9a7510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409788cd-39d0-4a09-8e75-795fe7ff0334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409788cd-39d0-4a09-8e75-795fe7ff0334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8', 'volume_name': 'volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0db6f0-f89b-4fc8-8bb8-76f2fbf75576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0db6f0-f89b-4fc8-8bb8-76f2fbf75576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f81b3-1e79-4983-b013-a75216dfefd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:34 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8', 'volume_size': 1} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:34 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 1073741824" returned: 0 in 1.231s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:34 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 Sep 07 11:00:34 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:35 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209" returned: 0 in 0.411s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-97091769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58426e9f-c127-4c37-aba3-a220d8ad6bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:33Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Creating volume 58426e9f-c127-4c37-aba3-a220d8ad6bff {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:35 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:35 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff 1073741824 Sep 07 11:00:35 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9070d28c-355b-49e9-b70e-25285da96698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4150531-8812-4af5-b822-e0dcf889e209', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185f0607-f49d-41f3-9fb1-0045839d9bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (8ce3dc58-c414-4449-bfca-605b1425969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf42de9-218d-4b51-b477-96d8ad51e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (c1fd9ff3-2a0a-486b-a843-3cac1d12f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af67493f-9c0f-414c-aba8-d97c8f6ab2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume volume-e4150531-8812-4af5-b822-e0dcf889e209 (e4150531-8812-4af5-b822-e0dcf889e209): created successfully Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185f0607-f49d-41f3-9fb1-0045839d9bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (563e7685-aad2-4ae8-8c18-92b6374b0e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf42de9-218d-4b51-b477-96d8ad51e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-577048069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3650dd9c-6bc7-4bd7-8ad5-914e2c1e866c,host='devstack@QuobyteHD#QuobyteHD',id=f2250afd-cb7f-4e9f-9829-0e17e0568acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:35Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa028eb2-bf5d-448a-8537-d6aada0ea2c1),volume_type_id=fa028eb2-bf5d-448a-8537-d6aada0ea2c1)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea4d438-dce9-4bf3-b205-1ed7e990745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea4d438-dce9-4bf3-b205-1ed7e990745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850a9c75-e3ce-46dc-999a-504119a66815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850a9c75-e3ce-46dc-999a-504119a66815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2250afd-cb7f-4e9f-9829-0e17e0568acd', 'volume_name': 'volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f25065-102f-4833-8685-9ffefc66af4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f25065-102f-4833-8685-9ffefc66af4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a46043c-074d-4b5d-bebf-54f4163fb08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Volume f2250afd-cb7f-4e9f-9829-0e17e0568acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd', 'volume_size': 1} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af67493f-9c0f-414c-aba8-d97c8f6ab2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883781598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54553668-3a6a-4cbe-9b2e-ae476bf6147c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:35Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f06fa7f-f86f-4836-b8a9-c02f5be3c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f06fa7f-f86f-4836-b8a9-c02f5be3c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de57e2-03ae-41a0-9849-3a907d043c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de57e2-03ae-41a0-9849-3a907d043c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54553668-3a6a-4cbe-9b2e-ae476bf6147c', 'volume_name': 'volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca2c4c5-c5d2-4c48-9699-27aaf2f06810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca2c4c5-c5d2-4c48-9699-27aaf2f06810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5624f029-4118-4433-941e-e5050c8b28a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume 54553668-3a6a-4cbe-9b2e-ae476bf6147c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c', 'volume_size': 1} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6d36021d-6fe2-48f0-a9f7-d683ac6617ce tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created volume successfully. Sep 07 11:00:35 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff 1073741824" returned: 0 in 0.542s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:35 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff Sep 07 11:00:35 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:36 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff" returned: 0 in 0.371s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1359223780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:34Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Creating volume c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:36 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174a9b18-eae3-4501-b1d7-cf50506a3e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58426e9f-c127-4c37-aba3-a220d8ad6bff', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:36 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 1073741824 Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2045b50-5e13-49ad-81f2-3ef579a307c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:36 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:36 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume volume-58426e9f-c127-4c37-aba3-a220d8ad6bff (58426e9f-c127-4c37-aba3-a220d8ad6bff): created successfully Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2045b50-5e13-49ad-81f2-3ef579a307c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (053b3047-4b75-408b-999e-9468b76fcedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0cda1b3c-38de-4bfd-9131-9959647091e4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created volume successfully. Sep 07 11:00:36 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 1073741824" returned: 0 in 0.557s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:36 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 Sep 07 11:00:36 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:36 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8" returned: 0 in 0.270s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3650dd9c-6bc7-4bd7-8ad5-914e2c1e866c,created_at=2026-09-07T09:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-577048069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3650dd9c-6bc7-4bd7-8ad5-914e2c1e866c,host='devstack@QuobyteHD#QuobyteHD',id=f2250afd-cb7f-4e9f-9829-0e17e0568acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188dd1676b404d7791ed25f507af15f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:35Z,use_quota=True,user_id='25980d52b1d04b78af7a6c0931bb87b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa028eb2-bf5d-448a-8537-d6aada0ea2c1),volume_type_id=fa028eb2-bf5d-448a-8537-d6aada0ea2c1)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Creating volume f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:36 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f81b3-1e79-4983-b013-a75216dfefd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06f58de-d777-4fd9-b67e-95f34dd4fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:37 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd 1073741824 Sep 07 11:00:37 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 (c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8): created successfully Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06f58de-d777-4fd9-b67e-95f34dd4fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (de83b975-2c95-4938-8ca5-ec0f48fba1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-274b84d3-2bc3-4a7a-be82-39bc0068b27f tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created volume successfully. Sep 07 11:00:37 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd 1073741824" returned: 0 in 0.657s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:37 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd Sep 07 11:00:37 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:37 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd" returned: 0 in 0.265s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883781598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54553668-3a6a-4cbe-9b2e-ae476bf6147c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe8c06c1c184800972613a25ab1a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:35Z,use_quota=True,user_id='824e625dd4d441e482b583cfc6e00209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Creating volume 54553668-3a6a-4cbe-9b2e-ae476bf6147c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:37 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a46043c-074d-4b5d-bebf-54f4163fb08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:37 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c 1073741824 Sep 07 11:00:37 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f41f03-975d-429b-b38d-7dbd9e1ec3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Volume volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd (f2250afd-cb7f-4e9f-9829-0e17e0568acd): created successfully Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f41f03-975d-429b-b38d-7dbd9e1ec3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Flow 'volume_create_manager' (8ce3dc58-c414-4449-bfca-605b1425969a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-32ff44ae-432a-4877-b1c4-1962c192d09e tempest-GroupSnapshotsTest-2075329994 None] Created volume successfully. Sep 07 11:00:38 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c 1073741824" returned: 0 in 0.574s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Flow 'volume_create_manager' (a062f0f5-352f-44d6-9f37-8caaf0bffe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368f2354-5705-4e3a-a6bb-215494f30fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368f2354-5705-4e3a-a6bb-215494f30fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f37522-40b6-40f9-802b-b0d83ba6f9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868dfcab0e214cf3ae0c8f847e1d7137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:38Z,use_quota=True,user_id='5068b8fc52554cf8afc57dcb6548d9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b8892f-7a2f-413b-ae1c-097d01f9ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b8892f-7a2f-413b-ae1c-097d01f9ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce7e6ae-ae5e-4c5a-bfb2-1ed9b706aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce7e6ae-ae5e-4c5a-bfb2-1ed9b706aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f37522-40b6-40f9-802b-b0d83ba6f9d5', 'volume_name': 'volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77036bc-4ab3-4f1d-8053-5d7ddd1d7c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77036bc-4ab3-4f1d-8053-5d7ddd1d7c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3ba0f6-a88d-4855-8625-4d9a2251898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Volume 34f37522-40b6-40f9-802b-b0d83ba6f9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5', 'volume_size': 1} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:38 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c Sep 07 11:00:38 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] GroupSnapshot 0193686d-751f-462b-9137-d55bad6921b5: creating. Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Group snapshot 0193686d-751f-462b-9137-d55bad6921b5: creating. {{(pid=87271) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:38 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c" returned: 0 in 0.301s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f37522-40b6-40f9-802b-b0d83ba6f9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868dfcab0e214cf3ae0c8f847e1d7137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:38Z,use_quota=True,user_id='5068b8fc52554cf8afc57dcb6548d9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Creating volume 34f37522-40b6-40f9-802b-b0d83ba6f9d5 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:38 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5624f029-4118-4433-941e-e5050c8b28a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:39 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 1073741824 Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce1ab0d-7386-4ad9-9c98-38040cb011d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:39 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:39 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Volume volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c (54553668-3a6a-4cbe-9b2e-ae476bf6147c): created successfully Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce1ab0d-7386-4ad9-9c98-38040cb011d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Flow 'volume_create_manager' (c1fd9ff3-2a0a-486b-a843-3cac1d12f25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cba975c5-eca3-4fea-9dd7-a4332fdbf4d4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created volume successfully. Sep 07 11:00:39 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 1073741824" returned: 0 in 0.454s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:39 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 Sep 07 11:00:39 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-54553668-3a6a-4cbe-9b2e-ae476bf6147c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-54553668-3a6a-4cbe-9b2e-ae476bf6147c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-quobyte-54553668-3a6a-4cbe-9b2e-ae476bf6147c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-54553668-3a6a-4cbe-9b2e-ae476bf6147c" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e415b46-db26-4ecc-b842-f4a812ed9a1b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:39 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.905s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:39 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c Sep 07 11:00:39 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3ba0f6-a88d-4855-8625-4d9a2251898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30552e28-557b-403d-81a3-5dcf27a9261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Creating offline snapshot 3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 of volume f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:00:39 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Volume volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 (34f37522-40b6-40f9-802b-b0d83ba6f9d5): created successfully Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30552e28-557b-403d-81a3-5dcf27a9261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Flow 'volume_create_manager' (a062f0f5-352f-44d6-9f37-8caaf0bffe20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49ad8c-b4eb-4c35-a8ef-53ac88966613]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-232b3b7c-5e75-4a2c-b077-1637d659630f tempest-CinderUnicodeTest-1589268902 None] Created volume successfully. Sep 07 11:00:39 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd Sep 07 11:00:39 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:40 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c" returned: 0 in 0.406s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:40 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c Sep 07 11:00:40 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:40 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd" returned: 0 in 0.395s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:40 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 1G Sep 07 11:00:40 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:40 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-54553668-3a6a-4cbe-9b2e-ae476bf6147c" returned: 0 in 0.277s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-54553668-3a6a-4cbe-9b2e-ae476bf6147c" released by "delete_volume" :: held 0.735s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created reservations ['f7cd894d-d250-406a-9ea0-42f1d9932ba0', '18dcc0dd-ad19-4034-9f8d-a9997154f7de', 'fc46c8f0-e116-4fa8-ac4c-1561eaba6fb3', 'b2ea2ef6-83d2-4baa-9cba-92237e9fb453'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:40 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:40 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:40 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:40 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Deleted volume successfully. Sep 07 11:00:40 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-quobyte-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f2c1bf25-6b7b-4c44-a552-d2d88d935df8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-54553668-3a6a-4cbe-9b2e-ae476bf6147c-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 1G" returned: 0 in 0.732s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:41 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 Sep 07 11:00:41 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8" acquired by "delete_volume" :: waited 0.048s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e6d829-ade2-45a3-b18f-9c749e8924b3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:41 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 Sep 07 11:00:41 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Flow 'volume_create_manager' (3232e921-d8a0-48c7-b979-5ac10f49a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e76115-e09b-46ad-b5d0-9ac9ddf4f51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e76115-e09b-46ad-b5d0-9ac9ddf4f51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-929670989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff18eb2-6550-4c91-8f04-abe4695c7d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868dfcab0e214cf3ae0c8f847e1d7137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:41Z,use_quota=True,user_id='5068b8fc52554cf8afc57dcb6548d9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb2b910-654a-43f8-a662-244850ad9978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb2b910-654a-43f8-a662-244850ad9978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7634f7-312e-4804-bb02-46ab0ab826df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7634f7-312e-4804-bb02-46ab0ab826df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff18eb2-6550-4c91-8f04-abe4695c7d65', 'volume_name': 'volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d061a9c2-24a9-4d4f-9ebd-53d9136613ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d061a9c2-24a9-4d4f-9ebd-53d9136613ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf3aed2-579a-46ba-a759-a2f3efc9316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:41 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Volume 8ff18eb2-6550-4c91-8f04-abe4695c7d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65', 'volume_size': 1} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:41 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" returned: 0 in 0.466s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:41 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:41 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 Sep 07 11:00:41 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:41 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8" returned: 0 in 0.507s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:41 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8 Sep 07 11:00:41 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:41 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" returned: 0 in 0.340s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:41 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.info Sep 07 11:00:41 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:41 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8" returned: 0 in 0.292s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8" released by "delete_volume" :: held 0.860s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:41 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created reservations ['ef4dc4ea-7723-4b63-95e0-a9452454d36a', '17ac7d49-d322-4586-afdb-57458c44530e', 'aaeda2e3-3dba-4532-834d-87a7366887ef', 'd389ed42-8a43-487d-bcfb-6d2ca737ee03'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:42 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:42 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-58426e9f-c127-4c37-aba3-a220d8ad6bff-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:42 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.info" returned: 0 in 0.333s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:42 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-58426e9f-c127-4c37-aba3-a220d8ad6bff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:42 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.info Sep 07 11:00:42 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-quobyte-58426e9f-c127-4c37-aba3-a220d8ad6bff" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-58426e9f-c127-4c37-aba3-a220d8ad6bff" acquired by "delete_volume" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[88681e08-8c96-4623-9ee0-d276027268ca]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:42 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Deleted volume successfully. Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-087d52af-c549-4a82-91d2-c354c02ec8d8 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-c08d9c78-8e9f-4ca7-bbb6-3006aee4aad8-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:42 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff Sep 07 11:00:42 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:42 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.info" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-929670989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff18eb2-6550-4c91-8f04-abe4695c7d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868dfcab0e214cf3ae0c8f847e1d7137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:41Z,use_quota=True,user_id='5068b8fc52554cf8afc57dcb6548d9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Creating volume 8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:42 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:42 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 1073741824 Sep 07 11:00:42 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eb0e7856-d9e8-4865-adb0-6bcc00213fa3 tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 0193686d-751f-462b-9137-d55bad6921b5: created successfully Sep 07 11:00:42 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:42 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff Sep 07 11:00:42 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:42 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 1073741824" returned: 0 in 0.427s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:42 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-58426e9f-c127-4c37-aba3-a220d8ad6bff" returned: 0 in 0.264s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:42 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 Sep 07 11:00:42 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-58426e9f-c127-4c37-aba3-a220d8ad6bff" released by "delete_volume" :: held 0.706s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created reservations ['da398324-361c-474c-a97a-e11d31f4cacf', '3cce74c9-e6fa-4b9a-a0e1-ec5ad2163616', 'd3f1fcab-0963-4e04-bdfd-21aad498850b', '9a990794-d60b-43a6-bb1e-42277e2a4a32'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:43 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:43 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:43 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65" returned: 0 in 0.265s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf3aed2-579a-46ba-a759-a2f3efc9316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0346318b-0acc-4332-b898-2f1c06bca080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:43 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Volume volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 (8ff18eb2-6550-4c91-8f04-abe4695c7d65): created successfully Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0346318b-0acc-4332-b898-2f1c06bca080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Flow 'volume_create_manager' (3232e921-d8a0-48c7-b979-5ac10f49a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c06a06ba-5949-434f-80c0-594912d18862 tempest-CinderUnicodeTest-1589268902 None] Created volume successfully. Sep 07 11:00:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 0193686d-751f-462b-9137-d55bad6921b5: deleting Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-e4150531-8812-4af5-b822-e0dcf889e209-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-e4150531-8812-4af5-b822-e0dcf889e209-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 0193686d-751f-462b-9137-d55bad6921b5: deleting {{(pid=87271) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 11:00:43 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.336s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-quobyte-e4150531-8812-4af5-b822-e0dcf889e209" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-f2250afd-cb7f-4e9f-9829-0e17e0568acd" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Deleted volume successfully. Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ae781576-2ac5-4cbc-bcf9-ef9327d065a4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-58426e9f-c127-4c37-aba3-a220d8ad6bff-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f2250afd-cb7f-4e9f-9829-0e17e0568acd" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-e4150531-8812-4af5-b822-e0dcf889e209" acquired by "delete_volume" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Deleting offline snapshot 3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 of volume f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] snapshot_file for this snap is: volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6288ed57-dce5-4fa3-bf6f-93eddf19af01]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a3a17-e2b1-4501-9f9a-143dcfb78179]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:43 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 Sep 07 11:00:43 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:43 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 Sep 07 11:00:43 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Creating offline snapshot fc4d156b-d86d-402f-b647-7e0c6f391247 of volume 8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7b78f-5e61-469d-9a1a-b55846bcb1ba]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209" returned: 0 in 0.417s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" returned: 0 in 0.419s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:00:44 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209 Sep 07 11:00:44 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 Sep 07 11:00:44 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61daafb-6f51-4b81-8364-77e730f7d6ad]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd Sep 07 11:00:44 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e4150531-8812-4af5-b822-e0dcf889e209" returned: 0 in 0.300s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-e4150531-8812-4af5-b822-e0dcf889e209" released by "delete_volume" :: held 0.809s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65" returned: 0 in 0.401s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 1G Sep 07 11:00:44 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created reservations ['09eeaf8b-c81e-4dd4-bc11-fd5574fb595c', '66c194e3-8623-4bd5-942b-ca2a6264e8e8', '5b543c5c-b430-41c7-a3d5-d534170036ba', 'ff703644-1596-4497-aacb-7328f8232a6f'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:44 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd" returned: 0 in 0.407s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:44 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 Sep 07 11:00:44 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-79cdf662-0002-4347-88c3-ac0433b37f97-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-79cdf662-0002-4347-88c3-ac0433b37f97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-quobyte-79cdf662-0002-4347-88c3-ac0433b37f97" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-79cdf662-0002-4347-88c3-ac0433b37f97" acquired by "delete_volume" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6ac103-b3db-43aa-92a2-c3ea2f5040d8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.348s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:44 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Deleted volume successfully. Sep 07 11:00:44 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 1G" returned: 0 in 0.508s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-990078af-8c0c-4132-ab00-0a8ed7de4281 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-e4150531-8812-4af5-b822-e0dcf889e209-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:44 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 Sep 07 11:00:44 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" returned: 0 in 0.447s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:44 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 Sep 07 11:00:44 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:44 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99 Sep 07 11:00:44 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:45 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247" returned: 0 in 0.291s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:45 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 is being set with open permissions: ugo+rw Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:45 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 Sep 07 11:00:45 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:45 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97" returned: 0 in 0.391s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:45 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd.3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" returned: 0 in 0.274s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:45 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97 Sep 07 11:00:45 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-3b54b6c4-6198-4ea6-8ffc-c6156b20fc99" released by "_delete_snapshot" :: held 1.677s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f2250afd-cb7f-4e9f-9829-0e17e0568acd" released by "delete_snapshot" :: held 1.724s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:45 devstack cinder-volume[87271]: WARNING cinder.quota [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2030234902 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2030234902, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:00:45 devstack cinder-volume[87271]: WARNING cinder.quota [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2030234902 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2030234902, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['07cb762c-9ba1-4f0d-b275-2909aa779b9e', 'ecf3f4b2-261f-4c92-933a-8991ae34430b', 'ea3f443e-025e-4678-a13d-e3bab8878e22', '7bb74348-7495-45f8-a731-6513545fdd6d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:45 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e5770a55-2b7a-4465-bf08-e1587fd2b388 tempest-GroupSnapshotsTest-2075329994 None] group_snapshot 0193686d-751f-462b-9137-d55bad6921b5: deleted successfully Sep 07 11:00:45 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247" returned: 0 in 0.286s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:45 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-79cdf662-0002-4347-88c3-ac0433b37f97" returned: 0 in 0.280s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:45 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.info Sep 07 11:00:45 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-79cdf662-0002-4347-88c3-ac0433b37f97" released by "delete_volume" :: held 0.724s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created reservations ['3c2b65ba-765f-4831-a181-bf09f3143b37', 'efc4b7b1-d052-4d62-89e7-54b9d7d12581', '13050753-67b1-4376-9011-094fa2c9aa92', '92dc841a-af18-4f20-87c0-c0c4375982c3'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:45 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:45 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:45 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.info" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:45 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.info is being set with open permissions: ugo+rw Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:45 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.info Sep 07 11:00:45 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:45 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-f1b1244e-d89f-491f-b269-6cee808c75ec-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.277s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:45 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Deleted volume successfully. Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-f1b1244e-d89f-491f-b269-6cee808c75ec-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-213effda-2d19-4dc8-8ffa-4e44d5187bc4 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-79cdf662-0002-4347-88c3-ac0433b37f97-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "cinder-quobyte-f1b1244e-d89f-491f-b269-6cee808c75ec" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-f1b1244e-d89f-491f-b269-6cee808c75ec" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:46 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75f179d-2b26-4834-9c7c-156d6e2e2310]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.info" returned: 0 in 0.339s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-db265ce4-ee8a-48b5-8a9f-1b29d09409bc tempest-CinderUnicodeTest-1589268902 None] Create snapshot completed successfully Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "cinder-quobyte-f2250afd-cb7f-4e9f-9829-0e17e0568acd" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f2250afd-cb7f-4e9f-9829-0e17e0568acd" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:46 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec Sep 07 11:00:46 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[790bde7c-88ba-4007-a2db-562750cceac2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:46 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd Sep 07 11:00:46 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:46 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec" returned: 0 in 0.401s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:46 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec Sep 07 11:00:46 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:46 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd" returned: 0 in 0.381s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:46 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd Sep 07 11:00:46 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:46 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f1b1244e-d89f-491f-b269-6cee808c75ec" returned: 0 in 0.271s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-quobyte-f1b1244e-d89f-491f-b269-6cee808c75ec" released by "delete_volume" :: held 0.718s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Created reservations ['da1ff1de-4b05-4beb-b58a-16abdea0d9c8', 'd7fc3610-4ff3-481b-89b1-c149adf35740', '3bd20b8a-64b8-4830-beec-9917e7f044dc', '24ebf745-7c50-4ab1-a763-2ba49ab3e415'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:46 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f2250afd-cb7f-4e9f-9829-0e17e0568acd" returned: 0 in 0.273s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:46 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:46 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Lock "cinder-quobyte-f2250afd-cb7f-4e9f-9829-0e17e0568acd" released by "delete_volume" :: held 0.721s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['6822cff0-5274-464e-a60b-c5aa49b2fede'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:46 devstack cinder-volume[87271]: WARNING cinder.quota [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2030234902 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2030234902, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:00:46 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Created reservations ['dc91079f-2cf5-4faf-9f86-7fbd320547fb', '8eae88b6-65cc-4958-9c0c-1f4de936c5fd', 'd3073712-2794-41f9-90b0-559530582851', '99c3ce5e-ecd0-43b9-afae-9be5286732ac'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:47 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.274s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "cinder-fc4d156b-d86d-402f-b647-7e0c6f391247-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Deleted volume successfully. Sep 07 11:00:47 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:47 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-fc4d156b-d86d-402f-b647-7e0c6f391247-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "cinder-quobyte-8ff18eb2-6550-4c91-8f04-abe4695c7d65" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-510e8ab7-3474-4e28-bc36-b3e188843183 tempest-CreateVolumesFromSourceVolumeTest-1873939253 None] Lock "cinder-f1b1244e-d89f-491f-b269-6cee808c75ec-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-8ff18eb2-6550-4c91-8f04-abe4695c7d65" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "cinder-quobyte-fc4d156b-d86d-402f-b647-7e0c6f391247" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-fc4d156b-d86d-402f-b647-7e0c6f391247" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Deleting offline snapshot fc4d156b-d86d-402f-b647-7e0c6f391247 of volume 8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] snapshot_file for this snap is: volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff2b352-3f97-404f-b544-3499a41b6f59]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:47 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.319s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a6b33b06-d3d1-4f97-9243-bee6a79f9011 tempest-GroupSnapshotsTest-2075329994 None] Delete group completed successfully. Sep 07 11:00:47 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 Sep 07 11:00:47 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:47 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e57a207-6bb2-4329-810e-a4da416c3bc6]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:47 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 Sep 07 11:00:47 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:48 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65" returned: 0 in 0.482s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:48 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 Sep 07 11:00:48 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:48 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247" returned: 0 in 0.464s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:48 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247 Sep 07 11:00:48 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:49 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65.fc4d156b-d86d-402f-b647-7e0c6f391247" returned: 0 in 0.378s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-fc4d156b-d86d-402f-b647-7e0c6f391247" released by "_delete_snapshot" :: held 1.970s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-8ff18eb2-6550-4c91-8f04-abe4695c7d65" released by "delete_snapshot" :: held 2.007s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:49 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Created reservations ['38477cb5-1bc7-49cb-a032-ac75776a4bdb', '090345fe-c8ff-4af3-a83e-ebef1b2763f7', '6e54e10a-9ec3-45ed-85d5-8b9f47f2b546', 'fa273a33-5965-43b6-b456-6b15f625d2c5'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Delete snapshot completed successfully. Sep 07 11:00:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5f2e9eb-81b9-499e-9753-af23354a58ee tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-fc4d156b-d86d-402f-b647-7e0c6f391247-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "cinder-8ff18eb2-6550-4c91-8f04-abe4695c7d65-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-8ff18eb2-6550-4c91-8f04-abe4695c7d65-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "cinder-quobyte-8ff18eb2-6550-4c91-8f04-abe4695c7d65" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-8ff18eb2-6550-4c91-8f04-abe4695c7d65" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[415d9f8b-fcf6-492b-8c05-d4f0ff1aa16a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:50 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 Sep 07 11:00:50 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:51 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65" returned: 0 in 0.443s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:51 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65 Sep 07 11:00:51 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Flow 'volume_create_manager' (a11e5b40-1ed8-4d48-88c2-1701bbaaa552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf05d0c-cdd7-490f-824b-5b3593a0db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf05d0c-cdd7-490f-824b-5b3593a0db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-448782295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2bade9-327c-4942-90e7-3987ef3f032d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c82d3c41234e1cb7979874f6ae7a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:51Z,use_quota=True,user_id='c42899a937e044d9be3cc5ec2b11d434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173d22e7-cbbc-49a6-8ab2-0e5ce5d70179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173d22e7-cbbc-49a6-8ab2-0e5ce5d70179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6530b623-17ce-4476-8135-403824360ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6530b623-17ce-4476-8135-403824360ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2bade9-327c-4942-90e7-3987ef3f032d', 'volume_name': 'volume-ff2bade9-327c-4942-90e7-3987ef3f032d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda18642-a788-4d84-b6f3-eaa9626e16d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda18642-a788-4d84-b6f3-eaa9626e16d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f31ce-5758-4f0f-a997-573c5696f989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:51 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Volume ff2bade9-327c-4942-90e7-3987ef3f032d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2bade9-327c-4942-90e7-3987ef3f032d', 'volume_size': 1} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-448782295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2bade9-327c-4942-90e7-3987ef3f032d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c82d3c41234e1cb7979874f6ae7a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:51Z,use_quota=True,user_id='c42899a937e044d9be3cc5ec2b11d434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Creating volume ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:51 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:51 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d 1073741824 Sep 07 11:00:51 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:51 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8ff18eb2-6550-4c91-8f04-abe4695c7d65" returned: 0 in 0.285s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-8ff18eb2-6550-4c91-8f04-abe4695c7d65" released by "delete_volume" :: held 0.806s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Created reservations ['3470c787-9a5f-4a59-8a93-fb01612c9642', '6c6f471a-0772-4277-908b-3e0a68addac3', 'b8ca2866-3794-4502-97ed-83588ccf6a34', '716b1d40-a8e7-45bf-a21d-b66f12b70f74'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:51 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:51 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "cinder-34f37522-40b6-40f9-802b-b0d83ba6f9d5-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-34f37522-40b6-40f9-802b-b0d83ba6f9d5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:51 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d 1073741824" returned: 0 in 0.570s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "cinder-quobyte-34f37522-40b6-40f9-802b-b0d83ba6f9d5" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-34f37522-40b6-40f9-802b-b0d83ba6f9d5" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[005d9da1-9202-429e-9f59-1c44063fd5fe]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:51 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.409s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Deleted volume successfully. Sep 07 11:00:51 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d Sep 07 11:00:51 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ad9da01f-9ddb-41a0-858c-b482ccb847da tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-8ff18eb2-6550-4c91-8f04-abe4695c7d65-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:52 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 Sep 07 11:00:52 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:52 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d" returned: 0 in 0.345s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f31ce-5758-4f0f-a997-573c5696f989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2bade9-327c-4942-90e7-3987ef3f032d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b297969a-887b-4692-bbfe-fc0c5df2edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:52 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Volume volume-ff2bade9-327c-4942-90e7-3987ef3f032d (ff2bade9-327c-4942-90e7-3987ef3f032d): created successfully Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b297969a-887b-4692-bbfe-fc0c5df2edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Flow 'volume_create_manager' (a11e5b40-1ed8-4d48-88c2-1701bbaaa552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2b5b547a-6dc9-4cff-b113-599a75453336 tempest-VolumeDependencyTests-1991418777 None] Created volume successfully. Sep 07 11:00:52 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5" returned: 0 in 0.498s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:52 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5 Sep 07 11:00:52 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:52 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-34f37522-40b6-40f9-802b-b0d83ba6f9d5" returned: 0 in 0.339s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-quobyte-34f37522-40b6-40f9-802b-b0d83ba6f9d5" released by "delete_volume" :: held 0.900s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Created reservations ['95076071-bb8f-481f-aae8-3fa0bc240f8c', 'a88d33d6-98a5-4361-bd57-65815b0d01e8', '10e669df-770c-46b5-aa95-a095fc000aa8', '9ce00c77-5b2b-48c0-8908-8186e588a30f'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:52 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:00:52 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:53 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:00:53 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Deleted volume successfully. Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a1435a9e-a84a-4471-b602-e8337a12efc3 tempest-CinderUnicodeTest-1589268902 None] Lock "cinder-34f37522-40b6-40f9-802b-b0d83ba6f9d5-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Creating offline snapshot 60736474-d7b5-4adb-92b9-5bd2fa07b913 of volume ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f372ed7-04c8-4102-8a63-ff459706fb21]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:53 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d Sep 07 11:00:53 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:54 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d" returned: 0 in 0.594s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:54 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 1G Sep 07 11:00:54 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:54 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 1G" returned: 0 in 0.736s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff2bade9-327c-4942-90e7-3987ef3f032d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:55 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff2bade9-327c-4942-90e7-3987ef3f032d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 Sep 07 11:00:55 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-80cdd697-1aca-4d5c-a8df-299bb3865cc1 tempest-GroupSnapshotsV319Test-487064204 None] Group tempest-GroupSnapshotsV319Test-Group-987711058: creating Sep 07 11:00:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-80cdd697-1aca-4d5c-a8df-299bb3865cc1 tempest-GroupSnapshotsV319Test-487064204 None] Group tempest-GroupSnapshotsV319Test-Group-987711058: created successfully Sep 07 11:00:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-80cdd697-1aca-4d5c-a8df-299bb3865cc1 tempest-GroupSnapshotsV319Test-487064204 None] Create group completed successfully. Sep 07 11:00:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-60125863-b007-43ba-9660-1db6134a0bda req-34eb04be-4676-464b-8456-2140d8aae5b2 tempest-TestShelveInstance-1948031024 None] Terminate volume connection completed successfully. Sep 07 11:00:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-60125863-b007-43ba-9660-1db6134a0bda req-34eb04be-4676-464b-8456-2140d8aae5b2 tempest-TestShelveInstance-1948031024 None] Deleting attachment edf7e4b5-66ed-4838-855d-eed30108b04f. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 11:00:55 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff2bade9-327c-4942-90e7-3987ef3f032d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913" returned: 0 in 0.392s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:55 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 is being set with open permissions: ugo+rw Sep 07 11:00:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:55 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 Sep 07 11:00:55 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:55 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913" returned: 0 in 0.279s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:55 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.info Sep 07 11:00:55 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:55 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.info" returned: 0 in 0.284s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:55 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.info is being set with open permissions: ugo+rw Sep 07 11:00:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:56 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.info Sep 07 11:00:56 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:56 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.info" returned: 0 in 0.306s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:56 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f03b53d7-19a4-4fe2-8a63-5417538ec42c tempest-VolumeDependencyTests-1991418777 None] Create snapshot completed successfully Sep 07 11:00:56 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Flow 'volume_create_manager' (68e13a98-b40c-4722-bf67-b1deac981ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2000b6-b340-4a25-80e2-5919150b7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2000b6-b340-4a25-80e2-5919150b7c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606482107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39e4fed5-15a6-48f7-938e-20c7e2069583,host='devstack@QuobyteHD#QuobyteHD',id=31b99ed1-1cf3-43ed-84a4-465243ae120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9deb82930b4ddea08e12a842584da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:57Z,use_quota=True,user_id='4f192a2757b543e99452bc2449b71ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398a6bf8-3ce3-4b2b-be18-5650385f0a54),volume_type_id=398a6bf8-3ce3-4b2b-be18-5650385f0a54)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0570a470-75f1-4d83-93d3-06cdf98f9a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0570a470-75f1-4d83-93d3-06cdf98f9a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453c4d39-7063-4867-b1f4-c7098ed98df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453c4d39-7063-4867-b1f4-c7098ed98df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b99ed1-1cf3-43ed-84a4-465243ae120e', 'volume_name': 'volume-31b99ed1-1cf3-43ed-84a4-465243ae120e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6abd39-9693-4afe-a76f-31df82cde662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6abd39-9693-4afe-a76f-31df82cde662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66041cb5-4ac6-439a-8d8e-5a79f6c00a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Volume 31b99ed1-1cf3-43ed-84a4-465243ae120e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b99ed1-1cf3-43ed-84a4-465243ae120e', 'volume_size': 1} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39e4fed5-15a6-48f7-938e-20c7e2069583,created_at=2026-09-07T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606482107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39e4fed5-15a6-48f7-938e-20c7e2069583,host='devstack@QuobyteHD#QuobyteHD',id=31b99ed1-1cf3-43ed-84a4-465243ae120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9deb82930b4ddea08e12a842584da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:57Z,use_quota=True,user_id='4f192a2757b543e99452bc2449b71ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398a6bf8-3ce3-4b2b-be18-5650385f0a54),volume_type_id=398a6bf8-3ce3-4b2b-be18-5650385f0a54)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Creating volume 31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:57 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:57 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e 1073741824 Sep 07 11:00:57 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Flow 'volume_create_manager' (89edd703-10d0-44fa-af55-d34648ef831a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e3d952-3062-4202-bfac-daece21aa76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e3d952-3062-4202-bfac-daece21aa76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1584151559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ec2621-3086-4045-b325-c29b9c761189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c82d3c41234e1cb7979874f6ae7a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60736474-d7b5-4adb-92b9-5bd2fa07b913,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:58Z,use_quota=True,user_id='c42899a937e044d9be3cc5ec2b11d434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872b8e77-8cdf-4015-a81d-28d532b8071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872b8e77-8cdf-4015-a81d-28d532b8071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10af087-4c7f-42a9-a024-31cad4e2c549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10af087-4c7f-42a9-a024-31cad4e2c549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7ec2621-3086-4045-b325-c29b9c761189', 'volume_name': 'volume-f7ec2621-3086-4045-b325-c29b9c761189', 'volume_size': 1, 'snapshot_id': '60736474-d7b5-4adb-92b9-5bd2fa07b913'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f5f10a-6b77-4d2f-8616-4fe0a24a59ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f5f10a-6b77-4d2f-8616-4fe0a24a59ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25d335e-a1fc-4a5b-8aa1-1960e919d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:57 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Volume f7ec2621-3086-4045-b325-c29b9c761189: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7ec2621-3086-4045-b325-c29b9c761189', 'volume_size': 1, 'snapshot_id': '60736474-d7b5-4adb-92b9-5bd2fa07b913'} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e 1073741824" returned: 0 in 0.750s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:57 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e Sep 07 11:00:57 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:58 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e" returned: 0 in 0.308s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.345s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-quobyte-60736474-d7b5-4adb-92b9-5bd2fa07b913-f7ec2621-3086-4045-b325-c29b9c761189" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66041cb5-4ac6-439a-8d8e-5a79f6c00a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b99ed1-1cf3-43ed-84a4-465243ae120e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fe2285-fb93-4e05-8207-13a6015ec18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-60736474-d7b5-4adb-92b9-5bd2fa07b913-f7ec2621-3086-4045-b325-c29b9c761189" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Creating volume f7ec2621-3086-4045-b325-c29b9c761189 from snapshot 60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-quobyte-f7ec2621-3086-4045-b325-c29b9c761189" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:00:58 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Volume volume-31b99ed1-1cf3-43ed-84a4-465243ae120e (31b99ed1-1cf3-43ed-84a4-465243ae120e): created successfully Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fe2285-fb93-4e05-8207-13a6015ec18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Flow 'volume_create_manager' (68e13a98-b40c-4722-bf67-b1deac981ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-f7ec2621-3086-4045-b325-c29b9c761189" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] snapshot: 60736474-d7b5-4adb-92b9-5bd2fa07b913, volume: f7ec2621-3086-4045-b325-c29b9c761189, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:00:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4034a18b-63cb-4219-b486-682f4aff1124 tempest-GroupSnapshotsV319Test-487064204 None] Created volume successfully. Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-59862680-a300-4e8b-ba0b-ee8fc2c6c046 req-242abf8b-09ea-4f89-8c5f-50ff210717b2 tempest-TestShelveInstance-1948031024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e6f953-b586-421b-96fd-e71d1c297b89]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:58 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 Sep 07 11:00:58 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (74aa8e1e-d101-49ad-a546-8128700bdd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c719c9e-1648-43cd-8cee-b237b625a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c719c9e-1648-43cd-8cee-b237b625a44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842880670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96439c7-61b4-41e1-8d48-3d1a22c426a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:59Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ecc6b-3eaf-4adf-bc67-9b18acdd52b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ecc6b-3eaf-4adf-bc67-9b18acdd52b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a58332-254e-4bd7-bdd6-47913c44c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a58332-254e-4bd7-bdd6-47913c44c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96439c7-61b4-41e1-8d48-3d1a22c426a4', 'volume_name': 'volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd1f149-1c37-4a3a-9fa1-2be5882561ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd1f149-1c37-4a3a-9fa1-2be5882561ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bfd77a-f968-4578-9a5e-ece86f72eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:00:58 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Volume a96439c7-61b4-41e1-8d48-3d1a22c426a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4', 'volume_size': 1} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:00:58 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913" returned: 0 in 0.387s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff2bade9-327c-4942-90e7-3987ef3f032d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d9aa3-29a3-47a6-9c53-0e36f801c4e5]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:00:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:58 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d Sep 07 11:00:58 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:59 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Sep 07 11:00:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d" returned: 0 in 0.365s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:00:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:00:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:00:59 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:00:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:00:59 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 Sep 07 11:00:59 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:00:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] GroupSnapshot 5ee7b314-069c-420e-89f7-2a02cb359c17: creating. Sep 07 11:00:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Group snapshot 5ee7b314-069c-420e-89f7-2a02cb359c17: creating. {{(pid=87271) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 11:00:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:03 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189" returned: 0 in 4.767s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:03 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:01:03 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Converted 1024.00 MB image at 214.75 MB/s Sep 07 11:01:03 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 is being set with open permissions: ugo+rw Sep 07 11:01:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:03 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 Sep 07 11:01:03 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:04 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-f7ec2621-3086-4045-b325-c29b9c761189" released by "_copy_volume_from_snapshot" :: held 5.855s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-60736474-d7b5-4adb-92b9-5bd2fa07b913-f7ec2621-3086-4045-b325-c29b9c761189" released by "_create_volume_from_snapshot" :: held 5.961s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.031s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-59862680-a300-4e8b-ba0b-ee8fc2c6c046 req-242abf8b-09ea-4f89-8c5f-50ff210717b2 tempest-TestShelveInstance-1948031024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.879s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-59862680-a300-4e8b-ba0b-ee8fc2c6c046 req-242abf8b-09ea-4f89-8c5f-50ff210717b2 tempest-TestShelveInstance-1948031024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.537s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842880670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96439c7-61b4-41e1-8d48-3d1a22c426a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:00:59Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Creating volume a96439c7-61b4-41e1-8d48-3d1a22c426a4 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:01:04 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:04 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 1073741824 Sep 07 11:01:04 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25d335e-a1fc-4a5b-8aa1-1960e919d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ec2621-3086-4045-b325-c29b9c761189', 'volume_size': 1, 'snapshot_id': '60736474-d7b5-4adb-92b9-5bd2fa07b913'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb64f05e-cdaa-4729-b876-ad8cd36a6787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:04 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Volume volume-f7ec2621-3086-4045-b325-c29b9c761189 (f7ec2621-3086-4045-b325-c29b9c761189): created successfully Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb64f05e-cdaa-4729-b876-ad8cd36a6787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Flow 'volume_create_manager' (89edd703-10d0-44fa-af55-d34648ef831a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-59862680-a300-4e8b-ba0b-ee8fc2c6c046 req-242abf8b-09ea-4f89-8c5f-50ff210717b2 tempest-TestShelveInstance-1948031024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-fceca44f-da6a-430d-aba3-e086162dc72a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec55d72f-9eaa-4912-a483-7992de7c8449', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 11:01:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a4666c7b-055b-4258-bcd7-48d3fbaed572 tempest-VolumeDependencyTests-1991418777 None] Created volume successfully. Sep 07 11:01:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-59862680-a300-4e8b-ba0b-ee8fc2c6c046 req-242abf8b-09ea-4f89-8c5f-50ff210717b2 tempest-TestShelveInstance-1948031024 None] attachment_update completed successfully. Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-60736474-d7b5-4adb-92b9-5bd2fa07b913-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-60736474-d7b5-4adb-92b9-5bd2fa07b913-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-quobyte-ff2bade9-327c-4942-90e7-3987ef3f032d" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-ff2bade9-327c-4942-90e7-3987ef3f032d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-quobyte-60736474-d7b5-4adb-92b9-5bd2fa07b913" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-60736474-d7b5-4adb-92b9-5bd2fa07b913" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Deleting offline snapshot 60736474-d7b5-4adb-92b9-5bd2fa07b913 of volume ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] snapshot_file for this snap is: volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d5aac-fa05-47cf-b567-99752633a16e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:04 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 Sep 07 11:01:04 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:04 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 1073741824" returned: 0 in 0.584s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:04 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 Sep 07 11:01:04 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:05 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913" returned: 0 in 0.495s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff2bade9-327c-4942-90e7-3987ef3f032d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f53c90-ae38-4677-af73-084316c11f34]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:05 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d Sep 07 11:01:05 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:05 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4" returned: 0 in 0.453s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.631s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bfd77a-f968-4578-9a5e-ece86f72eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1e0211-d3d8-4519-b56b-ec7a18841cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Creating offline snapshot 24f31070-9255-4a6f-944f-510f9964fb08 of volume 31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:01:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Volume volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 (a96439c7-61b4-41e1-8d48-3d1a22c426a4): created successfully Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1e0211-d3d8-4519-b56b-ec7a18841cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (74aa8e1e-d101-49ad-a546-8128700bdd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1b3526-9af8-4ab2-a1ed-7cff89144a2c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e98fe531-42f9-4f7d-a2d9-cca6cd09025d tempest-ProjectReaderTests-177484048 None] Created volume successfully. Sep 07 11:01:05 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e Sep 07 11:01:05 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:05 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d" returned: 0 in 0.702s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:05 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 Sep 07 11:01:05 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:05 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e" returned: 0 in 0.492s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:05 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 1G Sep 07 11:01:05 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:06 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913" returned: 0 in 0.437s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:06 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913 Sep 07 11:01:06 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:06 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 1G" returned: 0 in 0.561s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b99ed1-1cf3-43ed-84a4-465243ae120e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:06 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b99ed1-1cf3-43ed-84a4-465243ae120e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 Sep 07 11:01:06 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:06 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d.60736474-d7b5-4adb-92b9-5bd2fa07b913" returned: 0 in 0.491s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-60736474-d7b5-4adb-92b9-5bd2fa07b913" released by "_delete_snapshot" :: held 2.274s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-ff2bade9-327c-4942-90e7-3987ef3f032d" released by "delete_snapshot" :: held 2.306s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-a96439c7-61b4-41e1-8d48-3d1a22c426a4-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Lock "cinder-a96439c7-61b4-41e1-8d48-3d1a22c426a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Created reservations ['6235c19e-d0f8-4217-b004-c4c24044ce87', '0851a656-0f9b-4242-8786-beb9a8c94d98', '94b6e4c2-9a9b-4467-8ebc-905b436de31b', '6a096d85-4553-421f-8cec-1d9c966f2fb6'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-quobyte-a96439c7-61b4-41e1-8d48-3d1a22c426a4" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-a96439c7-61b4-41e1-8d48-3d1a22c426a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d0505f-5851-4961-abb5-d80194325e98]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:07 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b99ed1-1cf3-43ed-84a4-465243ae120e -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08" returned: 0 in 0.607s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:07 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:07 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 Sep 07 11:01:07 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Delete snapshot completed successfully. Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-535ae577-24ed-4859-9c18-fbe4e9505a8a tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-60736474-d7b5-4adb-92b9-5bd2fa07b913-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:07 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 Sep 07 11:01:07 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:07 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08" returned: 0 in 0.282s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:07 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.info Sep 07 11:01:07 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:07 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4" returned: 0 in 0.436s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:07 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4 Sep 07 11:01:07 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:07 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.info" returned: 0 in 0.335s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:07 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:07 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.info Sep 07 11:01:07 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-ff2bade9-327c-4942-90e7-3987ef3f032d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-ff2bade9-327c-4942-90e7-3987ef3f032d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:07 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a96439c7-61b4-41e1-8d48-3d1a22c426a4" returned: 0 in 0.413s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-quobyte-ff2bade9-327c-4942-90e7-3987ef3f032d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-a96439c7-61b4-41e1-8d48-3d1a22c426a4" released by "delete_volume" :: held 0.955s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-ff2bade9-327c-4942-90e7-3987ef3f032d" acquired by "delete_volume" :: waited 0.046s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[372fbfa2-7375-457e-8dbf-9fba3f39aea2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Created reservations ['96cbe525-1855-4158-94f7-c948e010d2fd', '216a3202-e301-40ca-9876-1e8473d3d901', 'c452ffb5-bd25-40fb-b31a-91f19b1fbdca', '48bcbb2a-55b0-4ab5-a8d7-7d7d94ebac0b'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:08 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.info" returned: 0 in 0.647s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.091s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:08 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d Sep 07 11:01:08 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:08 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2cb93157-94d9-4298-b44f-d73a04cd5338 tempest-GroupSnapshotsV319Test-487064204 None] group_snapshot 5ee7b314-069c-420e-89f7-2a02cb359c17: created successfully Sep 07 11:01:08 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:08 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:09 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d" returned: 0 in 0.946s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:09 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d Sep 07 11:01:09 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:09 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.659s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:09 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Deleted volume successfully. Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1802759c-ee23-4d46-815c-7b4f9d7249e1 tempest-ProjectReaderTests-177484048 None] Lock "cinder-a96439c7-61b4-41e1-8d48-3d1a22c426a4-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:09 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ff2bade9-327c-4942-90e7-3987ef3f032d" returned: 0 in 0.459s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-ff2bade9-327c-4942-90e7-3987ef3f032d" released by "delete_volume" :: held 1.575s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:09 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] group_snapshot 5ee7b314-069c-420e-89f7-2a02cb359c17: deleting Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] group_snapshot 5ee7b314-069c-420e-89f7-2a02cb359c17: deleting {{(pid=87271) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Created reservations ['e77da4c7-b7dc-4b49-895e-540947ecafee', 'bd94355b-6e12-4228-8898-a9759ead76f3', 'd15067db-66ba-4fde-9470-acb544b52217', 'd6f76630-45bf-489d-b900-93e2f0853ae5'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Acquiring lock "cinder-quobyte-31b99ed1-1cf3-43ed-84a4-465243ae120e" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Lock "cinder-quobyte-31b99ed1-1cf3-43ed-84a4-465243ae120e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Acquiring lock "cinder-quobyte-24f31070-9255-4a6f-944f-510f9964fb08" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Lock "cinder-quobyte-24f31070-9255-4a6f-944f-510f9964fb08" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Deleting offline snapshot 24f31070-9255-4a6f-944f-510f9964fb08 of volume 31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] snapshot_file for this snap is: volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf88f2-caf0-4c9b-baa4-0c95afbe4aab]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:10 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 Sep 07 11:01:10 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:10 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:10 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-f7ec2621-3086-4045-b325-c29b9c761189-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (c2c7bbf8-5215-4dc9-85a1-67fb8b71c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:10 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb5b62b-9334-4baa-b35a-90808208c20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.465s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-f7ec2621-3086-4045-b325-c29b9c761189-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb5b62b-9334-4baa-b35a-90808208c20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163827884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef67840-f88b-434f-94af-cc97fd8034f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:10Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7518c629-3bfc-46d9-843a-74d7255eeafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:10 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7518c629-3bfc-46d9-843a-74d7255eeafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9127ee40-52d1-4478-9583-6c4b5b7ddd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9127ee40-52d1-4478-9583-6c4b5b7ddd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef67840-f88b-434f-94af-cc97fd8034f2', 'volume_name': 'volume-cef67840-f88b-434f-94af-cc97fd8034f2', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e34f86d-3190-4bc2-bdbe-2d8f6a854ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e34f86d-3190-4bc2-bdbe-2d8f6a854ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9623059-9285-480c-a681-e6ee4a174121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:10 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Volume cef67840-f88b-434f-94af-cc97fd8034f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef67840-f88b-434f-94af-cc97fd8034f2', 'volume_size': 1} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163827884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef67840-f88b-434f-94af-cc97fd8034f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:10Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Creating volume cef67840-f88b-434f-94af-cc97fd8034f2 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:01:10 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Deleted volume successfully. Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:10 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 1073741824 Sep 07 11:01:10 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08" returned: 0 in 0.747s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b99ed1-1cf3-43ed-84a4-465243ae120e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:01:10 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:10 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-123372be-41b1-46f3-84d5-94bfeda41079 tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-ff2bade9-327c-4942-90e7-3987ef3f032d-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d5685b-9ad4-432c-8e5c-46b1079170f9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "cinder-quobyte-f7ec2621-3086-4045-b325-c29b9c761189" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-f7ec2621-3086-4045-b325-c29b9c761189" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6edaf-48c7-43f3-a2d5-bfeb12718f16]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:10 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 Sep 07 11:01:10 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:10 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e Sep 07 11:01:10 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:10 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.341s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:01:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:01:11 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 1073741824" returned: 0 in 0.684s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:11 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e" returned: 0 in 0.578s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:11 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189" returned: 0 in 0.535s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:11 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 Sep 07 11:01:11 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:11 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189 Sep 07 11:01:11 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:11 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 Sep 07 11:01:11 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:11 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2" returned: 0 in 0.345s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:11 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f7ec2621-3086-4045-b325-c29b9c761189" returned: 0 in 0.404s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9623059-9285-480c-a681-e6ee4a174121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef67840-f88b-434f-94af-cc97fd8034f2', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb0c0e2-d980-4b53-9c6c-b5b40ea8a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-quobyte-f7ec2621-3086-4045-b325-c29b9c761189" released by "delete_volume" :: held 0.998s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:11 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:11 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Volume volume-cef67840-f88b-434f-94af-cc97fd8034f2 (cef67840-f88b-434f-94af-cc97fd8034f2): created successfully Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb0c0e2-d980-4b53-9c6c-b5b40ea8a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (c2c7bbf8-5215-4dc9-85a1-67fb8b71c79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08" returned: 0 in 0.502s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c5c6aa4d-dfbc-4071-9fa0-b8f90482ad3e tempest-ProjectReaderTests-177484048 None] Created volume successfully. Sep 07 11:01:11 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08 Sep 07 11:01:11 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Created reservations ['c4ce4297-0f7e-4d0e-b48a-16738f33038e', 'fe0d3d5e-3b4d-4166-860d-5be38e2854cb', '8ec33c3e-5e7a-4d0a-bf6c-e3856af0409e', 'c56616c0-e0d8-4e12-84db-b2688001e6ea'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:12 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:12 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:12 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e.24f31070-9255-4a6f-944f-510f9964fb08" returned: 0 in 0.313s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Lock "cinder-quobyte-24f31070-9255-4a6f-944f-510f9964fb08" released by "_delete_snapshot" :: held 2.286s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Lock "cinder-quobyte-31b99ed1-1cf3-43ed-84a4-465243ae120e" released by "delete_snapshot" :: held 2.333s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:12 devstack cinder-volume[87271]: WARNING cinder.quota [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2017464656 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2017464656, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:01:12 devstack cinder-volume[87271]: WARNING cinder.quota [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2017464656 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2017464656, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:01:12 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.279s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Deleted volume successfully. Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] Created reservations ['be29bccc-6e0e-4426-9b43-1a59b2d4f24f', 'e3513859-72d8-48cd-ae50-18e0ae682462', '3d2f007a-56ee-4870-af85-5f4c3584e4e9', 'cd07ef70-4b85-4f12-a352-e425058b4a2f'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4cac9001-99ae-4e31-871a-abd4dc33064f tempest-VolumeDependencyTests-1991418777 None] Lock "cinder-f7ec2621-3086-4045-b325-c29b9c761189-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cdfafc6a-8111-4025-a622-0612ee8c5af1 tempest-GroupSnapshotsV319Test-487064204 None] group_snapshot 5ee7b314-069c-420e-89f7-2a02cb359c17: deleted successfully Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-cef67840-f88b-434f-94af-cc97fd8034f2-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Lock "cinder-cef67840-f88b-434f-94af-cc97fd8034f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-quobyte-cef67840-f88b-434f-94af-cc97fd8034f2" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-cef67840-f88b-434f-94af-cc97fd8034f2" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2802f170-6280-49a4-bbeb-262902f3abb0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:12 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 Sep 07 11:01:12 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:12 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2" returned: 0 in 0.401s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:13 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2 Sep 07 11:01:13 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:13 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cef67840-f88b-434f-94af-cc97fd8034f2" returned: 0 in 0.480s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Acquiring lock "cinder-quobyte-31b99ed1-1cf3-43ed-84a4-465243ae120e" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-cef67840-f88b-434f-94af-cc97fd8034f2" released by "delete_volume" :: held 0.951s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Lock "cinder-quobyte-31b99ed1-1cf3-43ed-84a4-465243ae120e" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee228bb3-8796-495d-9190-c24f82e67d76]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Created reservations ['51c380c0-b551-4324-b6ce-40798c62cfeb', '717d12c0-2bce-4c24-874f-91ac97fb5b11', 'd225d25a-312f-4019-838a-b3e29e4a5722', '4a5b667f-0b91-4a39-ba77-81c5d8d082df'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:13 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e Sep 07 11:01:13 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:13 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:13 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:14 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e" returned: 0 in 0.584s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:14 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e Sep 07 11:01:14 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:14 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.426s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Deleted volume successfully. Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa6718d8-1d66-4dff-b3a8-23dca8bbda90 tempest-ProjectReaderTests-177484048 None] Lock "cinder-cef67840-f88b-434f-94af-cc97fd8034f2-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:14 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-31b99ed1-1cf3-43ed-84a4-465243ae120e" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Lock "cinder-quobyte-31b99ed1-1cf3-43ed-84a4-465243ae120e" released by "delete_volume" :: held 1.026s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Created reservations ['8e833bef-e953-4744-a818-89dcad483162'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:14 devstack cinder-volume[87271]: WARNING cinder.quota [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2017464656 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2017464656, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Created reservations ['2db8fde6-484f-4a70-a8f1-91a31480766c', '8848358e-e102-430d-bba0-83c4965af501', 'ad73f237-98c7-408a-aaa3-18ca976db77f', '69f0aab1-5a4d-4361-a706-e3e80b768b3e'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:14 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:14 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:15 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.323s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-679ce683-c2cc-471b-ad98-ba7f4c550b06 tempest-GroupSnapshotsV319Test-487064204 None] Delete group completed successfully. Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (0ceca117-87fe-4b6f-9bfa-a804618dd28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b7f198-d90f-4451-bbb3-50b02929aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b7f198-d90f-4451-bbb3-50b02929aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1309147804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b530b3-f1dd-4c9c-b8c2-8df448412f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:16Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b4f16-bd86-4e3d-851e-2d7ecf206ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b4f16-bd86-4e3d-851e-2d7ecf206ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888f6e1d-a319-4191-a57c-d2b45d703e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888f6e1d-a319-4191-a57c-d2b45d703e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b530b3-f1dd-4c9c-b8c2-8df448412f09', 'volume_name': 'volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb175711-29ca-4553-8cba-da33d389dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb175711-29ca-4553-8cba-da33d389dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6134176-e9ad-407d-92c6-29f5b3c0c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:15 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Volume 53b530b3-f1dd-4c9c-b8c2-8df448412f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09', 'volume_size': 1} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1309147804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b530b3-f1dd-4c9c-b8c2-8df448412f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:16Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Creating volume 53b530b3-f1dd-4c9c-b8c2-8df448412f09 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:01:15 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:01:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:15 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 1073741824 Sep 07 11:01:15 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:16 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 1073741824" returned: 0 in 0.505s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:16 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 Sep 07 11:01:16 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:16 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09" returned: 0 in 0.372s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6134176-e9ad-407d-92c6-29f5b3c0c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7256eb83-5c3d-4fcf-85e4-6dea72351819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:16 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Volume volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 (53b530b3-f1dd-4c9c-b8c2-8df448412f09): created successfully Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7256eb83-5c3d-4fcf-85e4-6dea72351819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (0ceca117-87fe-4b6f-9bfa-a804618dd28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c2542fca-94f8-42a9-a83a-3a8d4f4449fe tempest-ProjectReaderTests-177484048 None] Created volume successfully. Sep 07 11:01:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-53b530b3-f1dd-4c9c-b8c2-8df448412f09-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Lock "cinder-53b530b3-f1dd-4c9c-b8c2-8df448412f09-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:17 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Flow 'volume_create_manager' (e043f9f7-f4a4-449c-8d6e-a9e19918dc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5495c-ec31-41dc-8d2d-b339c5e12d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5495c-ec31-41dc-8d2d-b339c5e12d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457190957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc1af70-3bd1-479c-9e1c-35627bd8f23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08acafad690f472cb9a5e1f97b1ca927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:18Z,use_quota=True,user_id='70c1db757a4c4b1aab1818ccfae45789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1d1c22-dca0-49d5-9155-f28a93a9ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1d1c22-dca0-49d5-9155-f28a93a9ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67023ed1-acc4-4ec6-8a84-d0934773e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67023ed1-acc4-4ec6-8a84-d0934773e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc1af70-3bd1-479c-9e1c-35627bd8f23c', 'volume_name': 'volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a19482-9e71-40af-b154-4120b0eb090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a19482-9e71-40af-b154-4120b0eb090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46aa367-f80c-428e-ada9-19d3470965a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:18 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Volume acc1af70-3bd1-479c-9e1c-35627bd8f23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c', 'volume_size': 1} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457190957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc1af70-3bd1-479c-9e1c-35627bd8f23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08acafad690f472cb9a5e1f97b1ca927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:18Z,use_quota=True,user_id='70c1db757a4c4b1aab1818ccfae45789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Creating volume acc1af70-3bd1-479c-9e1c-35627bd8f23c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:01:18 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-quobyte-53b530b3-f1dd-4c9c-b8c2-8df448412f09" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:18 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c 1073741824 Sep 07 11:01:18 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-53b530b3-f1dd-4c9c-b8c2-8df448412f09" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c71629e-eee9-4048-b0d2-b4a7422a69c8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:18 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 Sep 07 11:01:18 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:18 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c 1073741824" returned: 0 in 0.614s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:18 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09" returned: 0 in 0.551s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:18 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09 Sep 07 11:01:18 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:18 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c Sep 07 11:01:18 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:19 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-53b530b3-f1dd-4c9c-b8c2-8df448412f09" returned: 0 in 0.437s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-53b530b3-f1dd-4c9c-b8c2-8df448412f09" released by "delete_volume" :: held 1.041s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=210,cinder:INSERT=64,cinder:UPDATE=240,cinder:DELETE=17 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:01:19 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c" returned: 0 in 0.483s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46aa367-f80c-428e-ada9-19d3470965a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d95f7b4-6556-4c56-8f45-bb07ea2f2cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Created reservations ['137f8b2f-c13a-42b5-bc6f-767248c2c53d', '19cf5ce4-9d9f-46ff-9f04-2159366073fe', 'd94876b2-ff65-4de8-8482-8b8e39e4ebb5', '23831f86-ca71-4f03-b4cf-17bcd7cda67c'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Volume volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c (acc1af70-3bd1-479c-9e1c-35627bd8f23c): created successfully Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d95f7b4-6556-4c56-8f45-bb07ea2f2cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Flow 'volume_create_manager' (e043f9f7-f4a4-449c-8d6e-a9e19918dc10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-273cf89b-265f-4102-8f16-c47e65138cf1 tempest-ProjectReaderTests-661512886 None] Created volume successfully. Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:19 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:19 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:19 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.342s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Deleted volume successfully. Sep 07 11:01:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ea48b881-4242-4cd7-b77d-358e7f251037 tempest-ProjectReaderTests-177484048 None] Lock "cinder-53b530b3-f1dd-4c9c-b8c2-8df448412f09-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Acquiring lock "cinder-acc1af70-3bd1-479c-9e1c-35627bd8f23c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Lock "cinder-acc1af70-3bd1-479c-9e1c-35627bd8f23c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Acquiring lock "cinder-quobyte-acc1af70-3bd1-479c-9e1c-35627bd8f23c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Lock "cinder-quobyte-acc1af70-3bd1-479c-9e1c-35627bd8f23c" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63c94c4-9c05-45ae-834b-a939767648f8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:20 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c Sep 07 11:01:20 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (4426ccf1-4ea4-43a4-98ec-abdfa42c1638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1c15cf-8b4c-4c9b-aae7-63f76742d393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1c15cf-8b4c-4c9b-aae7-63f76742d393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738529981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3503cda2-ba48-4cd5-9200-6c2d4d491391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:21Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a928a52-5211-4b9d-8dc1-5aa3af5fccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a928a52-5211-4b9d-8dc1-5aa3af5fccb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782eeac3-a4c0-45d0-9633-42c074c76b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782eeac3-a4c0-45d0-9633-42c074c76b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3503cda2-ba48-4cd5-9200-6c2d4d491391', 'volume_name': 'volume-3503cda2-ba48-4cd5-9200-6c2d4d491391', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:21 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a437572-1ad0-41c6-98dc-d9afbdadda5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a437572-1ad0-41c6-98dc-d9afbdadda5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3262ba7e-231b-46d8-9619-cdb567ab5df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Volume 3503cda2-ba48-4cd5-9200-6c2d4d491391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3503cda2-ba48-4cd5-9200-6c2d4d491391', 'volume_size': 1} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738529981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3503cda2-ba48-4cd5-9200-6c2d4d491391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdefcfd836344678a900b1b80d0ec9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:21Z,use_quota=True,user_id='195a0401e5264740925008494f5d76a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Creating volume 3503cda2-ba48-4cd5-9200-6c2d4d491391 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:01:21 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c" returned: 0 in 0.545s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:21 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 1073741824 Sep 07 11:01:21 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:21 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c Sep 07 11:01:21 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:21 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-acc1af70-3bd1-479c-9e1c-35627bd8f23c" returned: 0 in 0.368s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Lock "cinder-quobyte-acc1af70-3bd1-479c-9e1c-35627bd8f23c" released by "delete_volume" :: held 0.969s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Created reservations ['be8e16ca-7b76-46f0-883c-9ebaaabf18ea', '253df295-6e1f-4de1-9b21-cf9a91420f54', 'e41d48f0-58a3-4c6c-81a4-35999b2bb7fa', 'c505fe99-92ff-427a-927d-69f315c942c2'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:INSERT=73,cinder:UPDATE=284,cinder:SELECT=218,cinder:DELETE=17 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:21 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 1073741824" returned: 0 in 0.632s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:21 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:21 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:21 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 Sep 07 11:01:21 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:22 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Deleted volume successfully. Sep 07 11:01:22 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391" returned: 0 in 0.300s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7c71cb77-83a3-449c-a7e4-f6a1af52f976 tempest-ProjectReaderTests-661512886 None] Lock "cinder-acc1af70-3bd1-479c-9e1c-35627bd8f23c-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3262ba7e-231b-46d8-9619-cdb567ab5df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3503cda2-ba48-4cd5-9200-6c2d4d491391', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d559186-2d21-46ef-aa62-81cca872d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:22 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Volume volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 (3503cda2-ba48-4cd5-9200-6c2d4d491391): created successfully Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d559186-2d21-46ef-aa62-81cca872d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Flow 'volume_create_manager' (4426ccf1-4ea4-43a4-98ec-abdfa42c1638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8902a812-621b-4172-af7b-bf2b9171c978 tempest-ProjectReaderTests-177484048 None] Created volume successfully. Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-3503cda2-ba48-4cd5-9200-6c2d4d491391-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Lock "cinder-3503cda2-ba48-4cd5-9200-6c2d4d491391-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Acquiring lock "cinder-quobyte-3503cda2-ba48-4cd5-9200-6c2d4d491391" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-3503cda2-ba48-4cd5-9200-6c2d4d491391" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[584ef984-4819-48bc-aa8a-b291b556e4da]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Flow 'volume_create_manager' (666d3193-11d1-4820-a307-0a60ccbe59ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82481198-40b9-496b-ae30-837a6aafbc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82481198-40b9-496b-ae30-837a6aafbc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423003979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93251584-568a-45ca-b0ba-34bfe58bc2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08acafad690f472cb9a5e1f97b1ca927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:24Z,use_quota=True,user_id='70c1db757a4c4b1aab1818ccfae45789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1fdbf1-51f9-4456-a671-07e575954710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1fdbf1-51f9-4456-a671-07e575954710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f40393c-e564-48c1-83cd-ad61de2d2cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f40393c-e564-48c1-83cd-ad61de2d2cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93251584-568a-45ca-b0ba-34bfe58bc2cb', 'volume_name': 'volume-93251584-568a-45ca-b0ba-34bfe58bc2cb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9a9a17-215f-4e1c-ac91-2a2e968d7a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9a9a17-215f-4e1c-ac91-2a2e968d7a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf1a760-a333-4dcc-8ad9-d97727cb6e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:23 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Volume 93251584-568a-45ca-b0ba-34bfe58bc2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93251584-568a-45ca-b0ba-34bfe58bc2cb', 'volume_size': 1} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423003979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93251584-568a-45ca-b0ba-34bfe58bc2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08acafad690f472cb9a5e1f97b1ca927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:24Z,use_quota=True,user_id='70c1db757a4c4b1aab1818ccfae45789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Creating volume 93251584-568a-45ca-b0ba-34bfe58bc2cb {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:01:23 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:01:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:23 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 Sep 07 11:01:23 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:23 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb 1073741824 Sep 07 11:01:23 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:24 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391" returned: 0 in 0.494s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:24 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391 Sep 07 11:01:24 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:24 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb 1073741824" returned: 0 in 0.567s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:24 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3503cda2-ba48-4cd5-9200-6c2d4d491391" returned: 0 in 0.328s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:24 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb Sep 07 11:01:24 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Lock "cinder-quobyte-3503cda2-ba48-4cd5-9200-6c2d4d491391" released by "delete_volume" :: held 0.918s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Created reservations ['94e6a5bb-e0f5-4cc2-a5be-c79fbb7c8e4e', '5579540d-1745-471e-a461-a01ba45ca783', '41de6df4-b96b-4548-bb63-24716d4aab51', '2f3dff7f-74ed-4b12-9241-b76b9e112373'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:24 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb" returned: 0 in 0.388s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:24 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:24 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf1a760-a333-4dcc-8ad9-d97727cb6e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93251584-568a-45ca-b0ba-34bfe58bc2cb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc22d807-c974-4e9a-a0ac-dca65e29d7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Volume volume-93251584-568a-45ca-b0ba-34bfe58bc2cb (93251584-568a-45ca-b0ba-34bfe58bc2cb): created successfully Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc22d807-c974-4e9a-a0ac-dca65e29d7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Flow 'volume_create_manager' (666d3193-11d1-4820-a307-0a60ccbe59ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6f7e2c66-5416-448e-9d67-ce2fffa18e0f tempest-ProjectReaderTests-661512886 None] Created volume successfully. Sep 07 11:01:24 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:24 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Deleted volume successfully. Sep 07 11:01:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7509dcbb-ea7a-4148-86ff-4d99d922e7bd tempest-ProjectReaderTests-177484048 None] Lock "cinder-3503cda2-ba48-4cd5-9200-6c2d4d491391-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Acquiring lock "cinder-93251584-568a-45ca-b0ba-34bfe58bc2cb-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Lock "cinder-93251584-568a-45ca-b0ba-34bfe58bc2cb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Acquiring lock "cinder-quobyte-93251584-568a-45ca-b0ba-34bfe58bc2cb" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Lock "cinder-quobyte-93251584-568a-45ca-b0ba-34bfe58bc2cb" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5236a1bf-a6f3-48f8-b1c2-98a5974eda79]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:26 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb Sep 07 11:01:26 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:26 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb" returned: 0 in 0.440s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:26 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb Sep 07 11:01:26 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:26 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-93251584-568a-45ca-b0ba-34bfe58bc2cb" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Lock "cinder-quobyte-93251584-568a-45ca-b0ba-34bfe58bc2cb" released by "delete_volume" :: held 0.796s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Created reservations ['d8fe7f7b-d9b4-496b-b36f-06f9f6399769', '66191674-7974-4610-8e48-9208202eac1d', '55ba649d-1e0a-4450-ad61-51b770ec75d5', 'd5dfe031-b937-4edd-a8f6-02391ea0e1f3'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:26 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:26 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:27 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.388s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:27 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:27 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Deleted volume successfully. Sep 07 11:01:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fa8cb54b-842a-4ead-abed-d981ea1a06f2 tempest-ProjectReaderTests-661512886 None] Lock "cinder-93251584-568a-45ca-b0ba-34bfe58bc2cb-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:36 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:INSERT=10,cinder:UPDATE=36,cinder:SELECT=17,cinder:DELETE=3 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:01:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=23,cinder:SELECT=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Flow 'volume_create_manager' (5a38f95c-2e4d-44fc-8ee1-cfb75fb09e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f310f57-de8e-4ecf-9ea8-9aa896906e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f310f57-de8e-4ecf-9ea8-9aa896906e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-803575353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39f7d65-7479-4bd5-a692-d59d1ca62097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3edbd6b2f644e1bca9af6aa16f1f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:44Z,use_quota=True,user_id='0aad335eba814ac78010920e013a91e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a289fc24-38f1-41e6-b439-76832fbc8b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a289fc24-38f1-41e6-b439-76832fbc8b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa588b2f-d200-4c5b-982e-18b80dfcb75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa588b2f-d200-4c5b-982e-18b80dfcb75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b39f7d65-7479-4bd5-a692-d59d1ca62097', 'volume_name': 'volume-b39f7d65-7479-4bd5-a692-d59d1ca62097', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b438a80-71d0-4754-b957-503a9cf79e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b438a80-71d0-4754-b957-503a9cf79e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03acd896-24e5-435a-945a-32955a0ae34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:43 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Volume b39f7d65-7479-4bd5-a692-d59d1ca62097: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b39f7d65-7479-4bd5-a692-d59d1ca62097', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 11:01:43 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Trying to clone b39f7d65-7479-4bd5-a692-d59d1ca62097 from image 705abe21-5cec-4130-9cb9-f60544709b95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 11:01:44 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 11:01:44 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Image download 20.69 MB at 20.69 MB/s Sep 07 11:01:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4b596c-eae0-41b8-8837-da16b2b71242]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:44 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD Sep 07 11:01:44 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:44 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:44 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 is fetched for user 0aad335eba814ac78010920e013a91e6. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 11:01:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e3dd73-0a3c-47c0-83c2-51bb53301532]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:44 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD Sep 07 11:01:44 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:45 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-803575353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39f7d65-7479-4bd5-a692-d59d1ca62097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3edbd6b2f644e1bca9af6aa16f1f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:01:44Z,use_quota=True,user_id='0aad335eba814ac78010920e013a91e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Creating volume b39f7d65-7479-4bd5-a692-d59d1ca62097 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:01:45 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:45 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 1073741824 Sep 07 11:01:45 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:45 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 1073741824" returned: 0 in 0.600s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:45 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 Sep 07 11:01:45 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:46 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097" returned: 0 in 0.267s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Attempting download of 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume b39f7d65-7479-4bd5-a692-d59d1ca62097. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[58731aac-00b7-48b4-be51-1c2287b7bd84]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_m81e404q {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:46 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_m81e404q Sep 07 11:01:46 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:46 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_m81e404q" returned: 0 in 0.378s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_m81e404q {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:46 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_m81e404q Sep 07 11:01:46 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:46 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_m81e404q" returned: 1 in 0.433s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_m81e404q' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed08301-ea36-4238-ae8e-342cbd97e424]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:47 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD Sep 07 11:01:47 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:47 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:47 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] 705abe21-5cec-4130-9cb9-f60544709b95 was qcow2, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 11:01:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:47 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 Sep 07 11:01:47 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:49 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097" returned: 0 in 2.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:49 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_7n4fdlridevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:01:49 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Converted 112.00 MB image at 49.82 MB/s Sep 07 11:01:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:49 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 1G Sep 07 11:01:49 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:50 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 1G" returned: 0 in 0.534s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Downloaded image 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume b39f7d65-7479-4bd5-a692-d59d1ca62097 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 for user 0aad335eba814ac78010920e013a91e6 is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Marking volume b39f7d65-7479-4bd5-a692-d59d1ca62097 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Copying metadata from image 705abe21-5cec-4130-9cb9-f60544709b95 to b39f7d65-7479-4bd5-a692-d59d1ca62097. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Creating volume glance metadata for volume b39f7d65-7479-4bd5-a692-d59d1ca62097 backed by image 705abe21-5cec-4130-9cb9-f60544709b95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03acd896-24e5-435a-945a-32955a0ae34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39f7d65-7479-4bd5-a692-d59d1ca62097', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba23c451-e54a-4de5-9513-7c7e2d439384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:01:50 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Volume volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 (b39f7d65-7479-4bd5-a692-d59d1ca62097): created successfully Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba23c451-e54a-4de5-9513-7c7e2d439384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:01:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Flow 'volume_create_manager' (5a38f95c-2e4d-44fc-8ee1-cfb75fb09e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:01:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-682c1df4-8d5c-4109-989f-239eccc0f58b tempest-VolumesImageMetadata-1551555503 None] Created volume successfully. Sep 07 11:01:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-967e5730-ba37-4520-a065-9f2f2cd7f331 tempest-TestShelveInstance-1948031024 None] Terminate volume connection completed successfully. Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-967e5730-ba37-4520-a065-9f2f2cd7f331 tempest-TestShelveInstance-1948031024 None] Deleting attachment ec55d72f-9eaa-4912-a483-7992de7c8449. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Acquiring lock "cinder-fceca44f-da6a-430d-aba3-e086162dc72a-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Lock "cinder-fceca44f-da6a-430d-aba3-e086162dc72a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Acquiring lock "cinder-quobyte-fceca44f-da6a-430d-aba3-e086162dc72a" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Lock "cinder-quobyte-fceca44f-da6a-430d-aba3-e086162dc72a" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95e6a2b-0217-4d75-a510-34cafba9a6e3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:51 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a Sep 07 11:01:51 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Acquiring lock "cinder-b39f7d65-7479-4bd5-a692-d59d1ca62097-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Lock "cinder-b39f7d65-7479-4bd5-a692-d59d1ca62097-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Acquiring lock "cinder-quobyte-b39f7d65-7479-4bd5-a692-d59d1ca62097" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Lock "cinder-quobyte-b39f7d65-7479-4bd5-a692-d59d1ca62097" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea89ae1-e33b-40f5-b15a-d63d77a0e942]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:52 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 Sep 07 11:01:52 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:52 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a" returned: 0 in 0.606s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:52 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a Sep 07 11:01:52 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:52 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097" returned: 0 in 0.587s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:52 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097 Sep 07 11:01:52 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:52 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fceca44f-da6a-430d-aba3-e086162dc72a" returned: 0 in 0.391s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Lock "cinder-quobyte-fceca44f-da6a-430d-aba3-e086162dc72a" released by "delete_volume" :: held 1.088s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:52 devstack cinder-volume[87271]: DEBUG cinder.quota [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Created reservations ['c79b3a15-fe99-4108-baee-4185760a701c', 'cce63d42-bbf5-424d-a854-caa0d0aa4f95', '6baef174-2ede-42d5-a628-f5b05f8b2cdb', '66a06d83-3e60-4db7-a373-1b19967c5a02'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:53 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b39f7d65-7479-4bd5-a692-d59d1ca62097" returned: 0 in 0.389s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:53 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:53 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Lock "cinder-quobyte-b39f7d65-7479-4bd5-a692-d59d1ca62097" released by "delete_volume" :: held 1.061s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Created reservations ['a84abe1f-d88d-4fb4-b7b8-95daf0f22db0', '6aa53d9b-1946-4448-8920-d2aee31e8a7b', '8a2f9a6e-a5c5-4f19-a49d-52d14fad7a8d', 'd7a2ad71-7d3f-4ca7-b324-ec8d260e37ff'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:01:53 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:01:53 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:01:53 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.manager [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:53 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Deleted volume successfully. Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [req-65f708a7-049c-4cde-b1af-f2b8a1f201c6 req-7f397a11-9cbe-4566-9975-bded2ed34f2f tempest-TestShelveInstance-1948031024 None] Lock "cinder-fceca44f-da6a-430d-aba3-e086162dc72a-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:01:53 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.331s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:01:53 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Deleted volume successfully. Sep 07 11:01:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fee7bbd3-d13e-4009-a7d0-2d9cf16e2018 tempest-VolumesImageMetadata-1551555503 None] Lock "cinder-b39f7d65-7479-4bd5-a692-d59d1ca62097-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Flow 'volume_create_manager' (591438f1-6398-4199-a7fc-1ac92813e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b16c55c-34f3-4c06-a46e-8b9920787290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b16c55c-34f3-4c06-a46e-8b9920787290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-239390348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d264269f-3df6-47d9-9167-8da8ff894bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9790210e4e6e491e8fc747e451c21820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:00Z,use_quota=True,user_id='617eb6e9090e47d092ba52ffb4d61094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eba9695-3ba2-441b-9cbb-f34509a1b989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eba9695-3ba2-441b-9cbb-f34509a1b989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96edf031-04b5-4613-9e78-f8b4c2de3420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96edf031-04b5-4613-9e78-f8b4c2de3420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd264269f-3df6-47d9-9167-8da8ff894bd1', 'volume_name': 'volume-d264269f-3df6-47d9-9167-8da8ff894bd1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb6b30d-9a0e-49ad-810d-5d5515c2c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb6b30d-9a0e-49ad-810d-5d5515c2c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1114b4b6-dd05-4c97-b334-ea2ff1ceb0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:00 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Volume d264269f-3df6-47d9-9167-8da8ff894bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d264269f-3df6-47d9-9167-8da8ff894bd1', 'volume_size': 1} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-239390348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d264269f-3df6-47d9-9167-8da8ff894bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9790210e4e6e491e8fc747e451c21820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:00Z,use_quota=True,user_id='617eb6e9090e47d092ba52ffb4d61094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Creating volume d264269f-3df6-47d9-9167-8da8ff894bd1 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:02:00 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:02:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:00 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 1073741824 Sep 07 11:02:00 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:01 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 1073741824" returned: 0 in 0.504s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:01 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 Sep 07 11:02:01 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:01 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1" returned: 0 in 0.381s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1114b4b6-dd05-4c97-b334-ea2ff1ceb0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d264269f-3df6-47d9-9167-8da8ff894bd1', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28dfabb-ede3-4a92-9ea2-d3f8937f98d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Volume volume-d264269f-3df6-47d9-9167-8da8ff894bd1 (d264269f-3df6-47d9-9167-8da8ff894bd1): created successfully Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28dfabb-ede3-4a92-9ea2-d3f8937f98d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Flow 'volume_create_manager' (591438f1-6398-4199-a7fc-1ac92813e010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-dae6a5f1-faaa-4b6f-86e7-5dc09ecd19ae tempest-VolumesMetadataTest-486722957 None] Created volume successfully. Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Flow 'volume_create_manager' (ab3466df-d177-4571-b4c7-97f9697eb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59efd60a-c479-473e-9594-e94968708fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59efd60a-c479-473e-9594-e94968708fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-27882190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4d47da-d556-4fad-9491-763c66c58291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6c0bd4fa004273a197d70c20bdf4e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:02Z,use_quota=True,user_id='5eb935292b214eb8802c3a099cf20e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6343b6c4-1b02-4ec9-a0d5-591268319830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6343b6c4-1b02-4ec9-a0d5-591268319830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d249be42-0508-43e8-86a6-bff62138da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d249be42-0508-43e8-86a6-bff62138da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4d47da-d556-4fad-9491-763c66c58291', 'volume_name': 'volume-0a4d47da-d556-4fad-9491-763c66c58291', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85458421-6b7f-4639-a6c5-8e70bb0fa306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85458421-6b7f-4639-a6c5-8e70bb0fa306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19d3351-93be-4a1d-acd3-a9f6afbdd9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Volume 0a4d47da-d556-4fad-9491-763c66c58291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4d47da-d556-4fad-9491-763c66c58291', 'volume_size': 1} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-27882190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4d47da-d556-4fad-9491-763c66c58291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6c0bd4fa004273a197d70c20bdf4e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:02Z,use_quota=True,user_id='5eb935292b214eb8802c3a099cf20e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Creating volume 0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:02:02 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:02:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:02 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 1073741824 Sep 07 11:02:02 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:03 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 1073741824" returned: 0 in 0.623s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:03 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 Sep 07 11:02:03 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:03 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291" returned: 0 in 0.303s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19d3351-93be-4a1d-acd3-a9f6afbdd9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4d47da-d556-4fad-9491-763c66c58291', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06feeadc-2cad-403a-8423-806459480f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Volume volume-0a4d47da-d556-4fad-9491-763c66c58291 (0a4d47da-d556-4fad-9491-763c66c58291): created successfully Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06feeadc-2cad-403a-8423-806459480f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Flow 'volume_create_manager' (ab3466df-d177-4571-b4c7-97f9697eb881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-765e77e0-80be-47a8-8d21-55bf7243ca67 tempest-SnapshotDependencyTests-1389257937 None] Created volume successfully. Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Acquiring lock "cinder-d264269f-3df6-47d9-9167-8da8ff894bd1-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Lock "cinder-d264269f-3df6-47d9-9167-8da8ff894bd1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Acquiring lock "cinder-quobyte-d264269f-3df6-47d9-9167-8da8ff894bd1" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Lock "cinder-quobyte-d264269f-3df6-47d9-9167-8da8ff894bd1" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7041f492-a49c-46ee-9a90-5c8765688bef]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:03 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 Sep 07 11:02:03 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:04 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1" returned: 0 in 0.410s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:04 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1 Sep 07 11:02:04 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:04 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d264269f-3df6-47d9-9167-8da8ff894bd1" returned: 0 in 0.261s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Lock "cinder-quobyte-d264269f-3df6-47d9-9167-8da8ff894bd1" released by "delete_volume" :: held 0.721s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Created reservations ['302d09f5-ce1f-4cf9-a36d-0c464c238d7d', 'cfdb6a81-507b-4fe9-90da-f2f236482be3', '03b1e337-62a9-4055-a5ca-1a13da28b561', '60fdf18f-541d-4beb-bb58-cda85b5f951d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:04 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:02:04 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Creating offline snapshot 095d6eae-67bb-4b4a-8343-a4d1245d59de of volume 0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8042b70e-c255-4544-91bc-465a96a9d63e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:04 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.355s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:02:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Deleted volume successfully. Sep 07 11:02:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02370b7e-d2ab-4d4f-986a-457b2479f9a9 tempest-VolumesMetadataTest-486722957 None] Lock "cinder-d264269f-3df6-47d9-9167-8da8ff894bd1-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:05 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 Sep 07 11:02:05 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:05 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291" returned: 0 in 0.478s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:05 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de 1G Sep 07 11:02:05 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:05 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de 1G" returned: 0 in 0.519s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a4d47da-d556-4fad-9491-763c66c58291 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:05 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a4d47da-d556-4fad-9491-763c66c58291 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de Sep 07 11:02:05 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:06 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a4d47da-d556-4fad-9491-763c66c58291 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de" returned: 0 in 0.329s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:06 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de is being set with open permissions: ugo+rw Sep 07 11:02:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:06 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de Sep 07 11:02:06 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:06 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:06 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.info Sep 07 11:02:06 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:06 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.info" returned: 0 in 0.293s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:06 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.info is being set with open permissions: ugo+rw Sep 07 11:02:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:06 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.info Sep 07 11:02:06 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:07 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.info" returned: 0 in 0.321s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-19531456-9eb8-478f-b3ea-035b54689754 tempest-SnapshotDependencyTests-1389257937 None] Create snapshot completed successfully Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Flow 'volume_create_manager' (8ad3c96a-20ea-4e63-a9a5-78bf3e7f18e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4619086e-afac-42a0-80e6-05514f4d5759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4619086e-afac-42a0-80e6-05514f4d5759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec964e9d-0c2f-4161-8341-59f529a1cd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6c0bd4fa004273a197d70c20bdf4e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=095d6eae-67bb-4b4a-8343-a4d1245d59de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:09Z,use_quota=True,user_id='5eb935292b214eb8802c3a099cf20e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2236ad-01c1-4a60-af88-05c37cfb23d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2236ad-01c1-4a60-af88-05c37cfb23d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97b3a7a-9c7a-4cc4-92eb-6eb31109ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97b3a7a-9c7a-4cc4-92eb-6eb31109ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec964e9d-0c2f-4161-8341-59f529a1cd20', 'volume_name': 'volume-ec964e9d-0c2f-4161-8341-59f529a1cd20', 'volume_size': 1, 'snapshot_id': '095d6eae-67bb-4b4a-8343-a4d1245d59de'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86e7aaf-838b-47d9-b732-8e9be1f3ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86e7aaf-838b-47d9-b732-8e9be1f3ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572ee25e-7deb-4197-83e3-dcab9e4ba087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:08 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Volume ec964e9d-0c2f-4161-8341-59f529a1cd20: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec964e9d-0c2f-4161-8341-59f529a1cd20', 'volume_size': 1, 'snapshot_id': '095d6eae-67bb-4b4a-8343-a4d1245d59de'} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-quobyte-095d6eae-67bb-4b4a-8343-a4d1245d59de-ec964e9d-0c2f-4161-8341-59f529a1cd20" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-095d6eae-67bb-4b4a-8343-a4d1245d59de-ec964e9d-0c2f-4161-8341-59f529a1cd20" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Creating volume ec964e9d-0c2f-4161-8341-59f529a1cd20 from snapshot 095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-quobyte-ec964e9d-0c2f-4161-8341-59f529a1cd20" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-ec964e9d-0c2f-4161-8341-59f529a1cd20" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] snapshot: 095d6eae-67bb-4b4a-8343-a4d1245d59de, volume: ec964e9d-0c2f-4161-8341-59f529a1cd20, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92396bc-397a-4e26-a601-cf0e8122a48f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:09 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de Sep 07 11:02:09 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:09 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de" returned: 0 in 0.463s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a4d47da-d556-4fad-9491-763c66c58291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69d2ca0-44e7-45b0-a3df-dad49a8a45d7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:09 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 Sep 07 11:02:09 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:09 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291" returned: 0 in 0.408s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:02:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:09 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 Sep 07 11:02:09 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:02:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:10 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:02:10 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:11 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.766s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:02:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:02:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:02:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:02:15 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20" returned: 0 in 5.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:02:15 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Converted 1024.00 MB image at 195.27 MB/s Sep 07 11:02:15 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 is being set with open permissions: ugo+rw Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:15 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 Sep 07 11:02:15 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:15 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-ec964e9d-0c2f-4161-8341-59f529a1cd20" released by "_copy_volume_from_snapshot" :: held 6.473s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-095d6eae-67bb-4b4a-8343-a4d1245d59de-ec964e9d-0c2f-4161-8341-59f529a1cd20" released by "_create_volume_from_snapshot" :: held 6.549s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.566s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572ee25e-7deb-4197-83e3-dcab9e4ba087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec964e9d-0c2f-4161-8341-59f529a1cd20', 'volume_size': 1, 'snapshot_id': '095d6eae-67bb-4b4a-8343-a4d1245d59de'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654c5542-36fd-4467-a7d9-146f11a5c41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:15 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Volume volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 (ec964e9d-0c2f-4161-8341-59f529a1cd20): created successfully Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654c5542-36fd-4467-a7d9-146f11a5c41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Flow 'volume_create_manager' (8ad3c96a-20ea-4e63-a9a5-78bf3e7f18e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0ce7d60c-1420-4423-b9b6-dc23e623fea2 tempest-SnapshotDependencyTests-1389257937 None] Created volume successfully. Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-095d6eae-67bb-4b4a-8343-a4d1245d59de-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-095d6eae-67bb-4b4a-8343-a4d1245d59de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-quobyte-0a4d47da-d556-4fad-9491-763c66c58291" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-0a4d47da-d556-4fad-9491-763c66c58291" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-quobyte-095d6eae-67bb-4b4a-8343-a4d1245d59de" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-095d6eae-67bb-4b4a-8343-a4d1245d59de" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Deleting offline snapshot 095d6eae-67bb-4b4a-8343-a4d1245d59de of volume 0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] snapshot_file for this snap is: volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f5053a-4825-4525-8ec4-64965627abd2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:16 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de Sep 07 11:02:16 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:16 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de" returned: 0 in 0.630s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a4d47da-d556-4fad-9491-763c66c58291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:02:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c1bd99-283b-4036-9703-b74a9ee5282c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:16 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 Sep 07 11:02:16 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:17 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291" returned: 0 in 0.634s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:17 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de Sep 07 11:02:17 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:17 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de" returned: 0 in 0.420s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:17 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de Sep 07 11:02:17 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:18 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291.095d6eae-67bb-4b4a-8343-a4d1245d59de" returned: 0 in 0.308s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-095d6eae-67bb-4b4a-8343-a4d1245d59de" released by "_delete_snapshot" :: held 2.158s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-0a4d47da-d556-4fad-9491-763c66c58291" released by "delete_snapshot" :: held 2.187s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:18 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Created reservations ['2c2125ab-b1f7-46d8-83f9-ae4fc0c54b73', '4ab34dc5-2928-4f45-a436-e1f85c8a37ac', '5b3998a3-6013-44ce-aa6f-3f3b638ff4c1', '51e17413-5062-41c1-ae47-38a1feb25c74'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:02:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Delete snapshot completed successfully. Sep 07 11:02:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1d58ee06-8597-4dc7-8804-247dccd362ed tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-095d6eae-67bb-4b4a-8343-a4d1245d59de-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-0a4d47da-d556-4fad-9491-763c66c58291-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-0a4d47da-d556-4fad-9491-763c66c58291-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-quobyte-0a4d47da-d556-4fad-9491-763c66c58291" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Flow 'volume_create_manager' (b3a666b5-1df3-41c7-a25c-9e82ec7f68b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f4811d-37fa-4c43-8d86-00d22adb2e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f4811d-37fa-4c43-8d86-00d22adb2e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0406df50-6399-4b73-8d79-cf2b99cb53f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae43249f0fab4196a374299842e87609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:19Z,use_quota=True,user_id='7e2193f1c55e4f0a92c5d132e27d69f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb381283-cb9e-409b-bc56-a62f2c488f49),volume_type_id=cb381283-cb9e-409b-bc56-a62f2c488f49)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b152492-a0e3-4a99-b78a-225e7dd0f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b152492-a0e3-4a99-b78a-225e7dd0f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb88dbce-398c-4133-be55-2ab4c6f8b081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-0a4d47da-d556-4fad-9491-763c66c58291" acquired by "delete_volume" :: waited 0.096s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81a19a-cbea-4cfa-97ea-266c20e8c6d7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:19 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 Sep 07 11:02:19 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb88dbce-398c-4133-be55-2ab4c6f8b081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0406df50-6399-4b73-8d79-cf2b99cb53f3', 'volume_name': 'volume-0406df50-6399-4b73-8d79-cf2b99cb53f3', 'volume_size': 1, 'image_id': '9b870593-2702-4d06-8186-1d0e3d653329', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b870593-2702-4d06-8186-1d0e3d653329', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '236bec5869f583d379c5a72542a51fec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae43249f0fab4196a374299842e87609', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2c845f04ae36c02e1e4a0ac66ab004167363abb36030d4e19756f426260e4276ad8f2aeafefee361ce84f2a1f5e8df477c187d07ec1f0c6f5f26e83109fc35b', 'id': '9b870593-2702-4d06-8186-1d0e3d653329', 'created_at': datetime.datetime(2026, 9, 7, 9, 2, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 2, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b870593-2702-4d06-8186-1d0e3d653329/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8092b81-2b50-4e7c-98fb-895fea2e6aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8092b81-2b50-4e7c-98fb-895fea2e6aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a488b0d3-95b1-43b0-a6a0-b63c723b1c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Volume 0406df50-6399-4b73-8d79-cf2b99cb53f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0406df50-6399-4b73-8d79-cf2b99cb53f3', 'volume_size': 1, 'image_id': '9b870593-2702-4d06-8186-1d0e3d653329', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b870593-2702-4d06-8186-1d0e3d653329', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '236bec5869f583d379c5a72542a51fec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae43249f0fab4196a374299842e87609', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2c845f04ae36c02e1e4a0ac66ab004167363abb36030d4e19756f426260e4276ad8f2aeafefee361ce84f2a1f5e8df477c187d07ec1f0c6f5f26e83109fc35b', 'id': '9b870593-2702-4d06-8186-1d0e3d653329', 'created_at': datetime.datetime(2026, 9, 7, 9, 2, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 2, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b870593-2702-4d06-8186-1d0e3d653329/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Trying to clone 0406df50-6399-4b73-8d79-cf2b99cb53f3 from image 9b870593-2702-4d06-8186-1d0e3d653329 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b870593-2702-4d06-8186-1d0e3d653329', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 11:02:19 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Image download 0.00 MB at 0.00 MB/s Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba825502-0ac7-43f0-9654-e178516aaecf]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:19 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291" returned: 0 in 0.474s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:19 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291 Sep 07 11:02:19 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:20 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD Sep 07 11:02:20 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:20 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0a4d47da-d556-4fad-9491-763c66c58291" returned: 0 in 0.299s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-0a4d47da-d556-4fad-9491-763c66c58291" released by "delete_volume" :: held 0.860s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:20 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Created reservations ['f93cf48b-b5d2-42fe-abef-259f27d85a44', 'e42552a2-ea82-4b56-b1ce-b62699860e19', 'f4329d3a-90f2-4255-8519-6dd0f3e5ef37', '28fabd01-4116-431c-b482-19ce259023e4'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:20 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD Sep 07 11:02:20 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:20 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:02:20 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:20 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD" returned: 1 in 0.442s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Temporary image 9b870593-2702-4d06-8186-1d0e3d653329 is fetched for user 7e2193f1c55e4f0a92c5d132e27d69f2. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 11:02:20 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:02:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Deleted volume successfully. Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-53365a78-f6b4-448a-b860-bb05b71d41a7 tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-0a4d47da-d556-4fad-9491-763c66c58291-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[422c6476-0322-4c50-bbe3-c3f4b75794e8]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:20 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD Sep 07 11:02:20 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:21 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:21 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD Sep 07 11:02:21 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-ec964e9d-0c2f-4161-8341-59f529a1cd20-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-ec964e9d-0c2f-4161-8341-59f529a1cd20-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "cinder-quobyte-ec964e9d-0c2f-4161-8341-59f529a1cd20" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-ec964e9d-0c2f-4161-8341-59f529a1cd20" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:21 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0406df50-6399-4b73-8d79-cf2b99cb53f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae43249f0fab4196a374299842e87609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:19Z,use_quota=True,user_id='7e2193f1c55e4f0a92c5d132e27d69f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb381283-cb9e-409b-bc56-a62f2c488f49),volume_type_id=cb381283-cb9e-409b-bc56-a62f2c488f49)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Creating volume 0406df50-6399-4b73-8d79-cf2b99cb53f3 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:02:21 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[05327803-4471-4857-99ae-8cfb666ebaf1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:21 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 1073741824 Sep 07 11:02:21 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:21 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 Sep 07 11:02:21 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:22 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20" returned: 0 in 0.570s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:22 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20 Sep 07 11:02:22 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:22 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 1073741824" returned: 0 in 0.702s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:22 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 Sep 07 11:02:22 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:22 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ec964e9d-0c2f-4161-8341-59f529a1cd20" returned: 0 in 0.329s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-quobyte-ec964e9d-0c2f-4161-8341-59f529a1cd20" released by "delete_volume" :: held 0.974s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Created reservations ['035144fd-508f-42e2-a21f-a9a9f03a1e69', '968d54ff-e156-4a00-9ccd-5f030a1d4c1c', 'd926c498-1b31-4553-869e-cde3e990b4c7', '1311d8d7-4062-41ae-b1f8-b5146213f757'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:22 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3" returned: 0 in 0.301s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:22 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:02:22 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Attempting download of 9b870593-2702-4d06-8186-1d0e3d653329 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b870593-2702-4d06-8186-1d0e3d653329', 'metadata': {}}])) to volume 0406df50-6399-4b73-8d79-cf2b99cb53f3. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec2dc1-30ee-4972-b7eb-7dde888667ac]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b870593-2702-4d06-8186-1d0e3d653329_0dbvd_9x {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:22 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b870593-2702-4d06-8186-1d0e3d653329_0dbvd_9x Sep 07 11:02:22 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:22 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.274s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:02:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Deleted volume successfully. Sep 07 11:02:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-3ddead03-e4fd-4a98-b54d-2433e0c9034a tempest-SnapshotDependencyTests-1389257937 None] Lock "cinder-ec964e9d-0c2f-4161-8341-59f529a1cd20-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:23 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b870593-2702-4d06-8186-1d0e3d653329_0dbvd_9x" returned: 0 in 0.337s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b870593-2702-4d06-8186-1d0e3d653329_0dbvd_9x {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:23 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b870593-2702-4d06-8186-1d0e3d653329_0dbvd_9x Sep 07 11:02:23 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:23 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b870593-2702-4d06-8186-1d0e3d653329_0dbvd_9x" returned: 1 in 0.350s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b870593-2702-4d06-8186-1d0e3d653329_0dbvd_9x' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82c34cf-bd18-401e-894d-c97ea333dd6e]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:23 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD Sep 07 11:02:23 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Flow 'volume_create_manager' (d9420da0-de59-4226-8659-d14969db4021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f26125f-ca6d-4360-843e-99fc497820dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f26125f-ca6d-4360-843e-99fc497820dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1369071184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fec9ad-9b49-48f3-83b0-5d0319f340fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37a43d864a44ea0940d6981c3732e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:24Z,use_quota=True,user_id='7a9aea34f2584a59b48f00b49493ccd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebc113f-6ebc-4537-8029-e4043c9eaf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebc113f-6ebc-4537-8029-e4043c9eaf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7954ed0-9a61-49d4-bf26-82508c26b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7954ed0-9a61-49d4-bf26-82508c26b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1fec9ad-9b49-48f3-83b0-5d0319f340fe', 'volume_name': 'volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891baa45-0e51-4286-9a55-7da53eb9c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891baa45-0e51-4286-9a55-7da53eb9c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a939dc3f-a3a8-4173-bc80-147452d70b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:23 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Volume e1fec9ad-9b49-48f3-83b0-5d0319f340fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe', 'volume_size': 1} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1369071184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fec9ad-9b49-48f3-83b0-5d0319f340fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37a43d864a44ea0940d6981c3732e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:02:24Z,use_quota=True,user_id='7a9aea34f2584a59b48f00b49493ccd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Creating volume e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:02:23 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:23 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe 1073741824 Sep 07 11:02:23 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:23 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:23 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD Sep 07 11:02:23 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:24 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] 9b870593-2702-4d06-8186-1d0e3d653329 was raw, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 11:02:24 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe 1073741824" returned: 0 in 0.478s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:24 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 Sep 07 11:02:24 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:24 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:02:24 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:24 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.284s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a939dc3f-a3a8-4173-bc80-147452d70b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930961a1-212d-47af-b913-5fe01fec2a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Volume volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe (e1fec9ad-9b49-48f3-83b0-5d0319f340fe): created successfully Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930961a1-212d-47af-b913-5fe01fec2a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Flow 'volume_create_manager' (d9420da0-de59-4226-8659-d14969db4021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-01f7b6fe-46dd-4d7a-8112-1253eb36c33a tempest-VolumesActionsTest-8769867 None] Created volume successfully. Sep 07 11:02:24 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3" returned: 0 in 0.593s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b870593-2702-4d06-8186-1d0e3d653329_1kub47q_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:02:24 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 11:02:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:24 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 1G Sep 07 11:02:24 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:25 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 1G" returned: 0 in 0.316s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Downloaded image 9b870593-2702-4d06-8186-1d0e3d653329 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b870593-2702-4d06-8186-1d0e3d653329', 'metadata': {}}])) to volume 0406df50-6399-4b73-8d79-cf2b99cb53f3 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Temporary image 9b870593-2702-4d06-8186-1d0e3d653329 for user 7e2193f1c55e4f0a92c5d132e27d69f2 is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Marking volume 0406df50-6399-4b73-8d79-cf2b99cb53f3 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Copying metadata from image 9b870593-2702-4d06-8186-1d0e3d653329 to 0406df50-6399-4b73-8d79-cf2b99cb53f3. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Creating volume glance metadata for volume 0406df50-6399-4b73-8d79-cf2b99cb53f3 backed by image 9b870593-2702-4d06-8186-1d0e3d653329 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9b870593-2702-4d06-8186-1d0e3d653329', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '236bec5869f583d379c5a72542a51fec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a488b0d3-95b1-43b0-a6a0-b63c723b1c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0406df50-6399-4b73-8d79-cf2b99cb53f3', 'volume_size': 1, 'image_id': '9b870593-2702-4d06-8186-1d0e3d653329', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b870593-2702-4d06-8186-1d0e3d653329', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '236bec5869f583d379c5a72542a51fec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae43249f0fab4196a374299842e87609', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2c845f04ae36c02e1e4a0ac66ab004167363abb36030d4e19756f426260e4276ad8f2aeafefee361ce84f2a1f5e8df477c187d07ec1f0c6f5f26e83109fc35b', 'id': '9b870593-2702-4d06-8186-1d0e3d653329', 'created_at': datetime.datetime(2026, 9, 7, 9, 2, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 2, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b870593-2702-4d06-8186-1d0e3d653329/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234aa5d7-990a-481b-9598-ab6d598c607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:02:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Volume volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 (0406df50-6399-4b73-8d79-cf2b99cb53f3): created successfully Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234aa5d7-990a-481b-9598-ab6d598c607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Flow 'volume_create_manager' (b3a666b5-1df3-41c7-a25c-9e82ec7f68b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:02:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-21c207fe-e49d-4f1c-9dda-7a86c690c06a tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Created volume successfully. Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Acquiring lock "cinder-0406df50-6399-4b73-8d79-cf2b99cb53f3-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "cinder-0406df50-6399-4b73-8d79-cf2b99cb53f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Acquiring lock "cinder-quobyte-0406df50-6399-4b73-8d79-cf2b99cb53f3" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "cinder-quobyte-0406df50-6399-4b73-8d79-cf2b99cb53f3" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc62b6-b28c-4b13-b747-c4f23ee8160b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:25 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 Sep 07 11:02:25 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:26 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3" returned: 0 in 0.385s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:26 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3 Sep 07 11:02:26 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:26 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-0406df50-6399-4b73-8d79-cf2b99cb53f3" returned: 0 in 0.310s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "cinder-quobyte-0406df50-6399-4b73-8d79-cf2b99cb53f3" released by "delete_volume" :: held 0.741s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:26 devstack cinder-volume[87271]: WARNING cinder.quota [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:02:26 devstack cinder-volume[87271]: WARNING cinder.quota [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Created reservations ['d10ba8b8-fbd8-450e-b4c0-95d3195373a8', 'e5659e82-0cc7-44a1-a443-2a0c4ed5021b', '7197eca8-4b7a-4186-bc26-174c98a8d56b', '54f62444-59ae-48e1-b640-bf38ee0cba31'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:26 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:02:26 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:26 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.293s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:26 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:02:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Deleted volume successfully. Sep 07 11:02:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e9850c5-3379-4390-bcb6-759c3a263e88 tempest-VolumeAndVolumeTypeFromImageTest-2082898389 None] Lock "cinder-0406df50-6399-4b73-8d79-cf2b99cb53f3-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-20bb4f8e-7c99-4e42-a3ef-ba2e168db9c9 tempest-VolumesActionsTest-8769867 None] Acquiring lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" by "attach_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-20bb4f8e-7c99-4e42-a3ef-ba2e168db9c9 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" acquired by "attach_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-20bb4f8e-7c99-4e42-a3ef-ba2e168db9c9 tempest-VolumesActionsTest-8769867 None] Attaching volume e1fec9ad-9b49-48f3-83b0-5d0319f340fe to instance 8662fff6-47cf-4d4f-b305-8a4122985916 at mountpoint /dev/vdb on host None. Sep 07 11:02:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-20bb4f8e-7c99-4e42-a3ef-ba2e168db9c9 tempest-VolumesActionsTest-8769867 None] Attach volume completed successfully. Sep 07 11:02:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-20bb4f8e-7c99-4e42-a3ef-ba2e168db9c9 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" released by "attach_volume" :: held 0.151s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-eca3d85a-6684-4865-aa30-795307a559d3 tempest-VolumesActionsTest-8769867 None] Acquiring lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-detach_volume" by "detach_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-eca3d85a-6684-4865-aa30-795307a559d3 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eca3d85a-6684-4865-aa30-795307a559d3 tempest-VolumesActionsTest-8769867 None] Detaching volume e1fec9ad-9b49-48f3-83b0-5d0319f340fe from instance 8662fff6-47cf-4d4f-b305-8a4122985916. Sep 07 11:02:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eca3d85a-6684-4865-aa30-795307a559d3 tempest-VolumesActionsTest-8769867 None] Detach volume completed successfully. Sep 07 11:02:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-eca3d85a-6684-4865-aa30-795307a559d3 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:46 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=82,cinder:SELECT=68,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:02:46 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=79,cinder:UPDATE=76,cinder:INSERT=29,cinder:DELETE=4 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:02:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c48132b9-495e-4464-9ad5-f10d665acac4 tempest-VolumesActionsTest-8769867 None] Acquiring lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" by "attach_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c48132b9-495e-4464-9ad5-f10d665acac4 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" acquired by "attach_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c48132b9-495e-4464-9ad5-f10d665acac4 tempest-VolumesActionsTest-8769867 None] Attaching volume e1fec9ad-9b49-48f3-83b0-5d0319f340fe to instance 183062ad-b78d-4837-bf04-a8e191d5a25d at mountpoint /dev/vdb on host None. Sep 07 11:02:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c48132b9-495e-4464-9ad5-f10d665acac4 tempest-VolumesActionsTest-8769867 None] Attach volume completed successfully. Sep 07 11:02:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c48132b9-495e-4464-9ad5-f10d665acac4 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" released by "attach_volume" :: held 0.091s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8a794268-3d63-4822-843f-5f07fa0a837f tempest-VolumesActionsTest-8769867 None] Acquiring lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-detach_volume" by "detach_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:02:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8a794268-3d63-4822-843f-5f07fa0a837f tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:02:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8a794268-3d63-4822-843f-5f07fa0a837f tempest-VolumesActionsTest-8769867 None] Detaching volume e1fec9ad-9b49-48f3-83b0-5d0319f340fe from instance 183062ad-b78d-4837-bf04-a8e191d5a25d. Sep 07 11:02:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8a794268-3d63-4822-843f-5f07fa0a837f tempest-VolumesActionsTest-8769867 None] Detach volume completed successfully. Sep 07 11:02:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8a794268-3d63-4822-843f-5f07fa0a837f tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:02:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:02:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:02:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[936d08a4-d6d8-40c9-a350-e06a729a7612]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:52 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:02:52 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:52 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.369s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be26ca9-ea69-4fe1-bb86-b6f878d9b7cb]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:52 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:02:52 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:52 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.376s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ff78fc82-d0c9-459c-92cf-229a3c6bf640l4o2dimm.img {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:52 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ff78fc82-d0c9-459c-92cf-229a3c6bf640l4o2dimm.img Sep 07 11:02:52 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:56 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ff78fc82-d0c9-459c-92cf-229a3c6bf640l4o2dimm.img" returned: 0 in 3.939s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:56 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab404ce6-9fb7-429d-86ed-12ee3a1eab76]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:02:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:02:56 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:02:56 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:02:57 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 07 11:02:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.535s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:02:57 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ff78fc82-d0c9-459c-92cf-229a3c6bf640l4o2dimm.img {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:02:57 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Converted 1024.00 MB image at 259.85 MB/s Sep 07 11:02:57 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] ff78fc82-d0c9-459c-92cf-229a3c6bf640 was raw, no need to convert to raw {{(pid=87271) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 11:03:07 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:INSERT=1,cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:03:07 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:10 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:03:10 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:10 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.263s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:03:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:03:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.831s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Uploaded volume to glance image-id: ff78fc82-d0c9-459c-92cf-229a3c6bf640. {{(pid=87271) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 11:03:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9b64af83-979d-4cdd-99ba-5fc78ce5db6c tempest-VolumesActionsTest-8769867 None] Copy volume to image completed successfully. Sep 07 11:03:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[23677f63-0846-4554-b355-7cd48f0960d7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:16 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:03:16 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:17 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:17 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f648a2-4f4f-4e49-8375-ee398ec2a879]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:17 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:03:17 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:17 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.347s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:17 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img Sep 07 11:03:17 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:21 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img" returned: 0 in 3.759s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dcf527-2f6c-41f3-b6ec-b4e2cf611f64]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:21 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:03:21 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:21 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.524s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe, size 1024.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:03:21 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Converted 1024.00 MB image at 272.29 MB/s Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] ed997f40-942f-41a8-ae39-204f2998d927 was raw, converting to qcow2 {{(pid=87271) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1c2dbd-a24a-4324-8934-c11c844d2f05]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:21 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img Sep 07 11:03:21 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:22 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img" returned: 0 in 0.315s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:22 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img Sep 07 11:03:22 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:22 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img" returned: 1 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img /opt/stack/data/cinder/conversion/vol_upload_m4x0rycm {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:22 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img /opt/stack/data/cinder/conversion/vol_upload_m4x0rycm Sep 07 11:03:22 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:22 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img /opt/stack/data/cinder/conversion/vol_upload_m4x0rycm" returned: 0 in 0.270s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Image conversion details: src /opt/stack/data/cinder/conversion/e1fec9ad-9b49-48f3-83b0-5d0319f340fe.temp_image.ed997f40-942f-41a8-ae39-204f2998d927f2bkv6yc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_m4x0rycm {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:03:22 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa4171-7fa7-49ab-a6d9-f737ce8117de]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m4x0rycm {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:22 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m4x0rycm Sep 07 11:03:22 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:22 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m4x0rycm" returned: 0 in 0.335s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.545s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Uploaded volume to glance image-id: ed997f40-942f-41a8-ae39-204f2998d927. {{(pid=87271) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 11:03:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8d119bbc-7141-4aaf-b165-698af9ca1060 tempest-VolumesActionsTest-8769867 None] Copy volume to image completed successfully. Sep 07 11:03:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Acquiring lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Acquiring lock "cinder-quobyte-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Lock "cinder-quobyte-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29467e-da44-4c76-8c82-4966ba39d109]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:25 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:03:25 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:26 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.347s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:26 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe Sep 07 11:03:26 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:26 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" returned: 0 in 0.235s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Lock "cinder-quobyte-e1fec9ad-9b49-48f3-83b0-5d0319f340fe" released by "delete_volume" :: held 0.621s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Created reservations ['63e80c1b-4001-4e2a-a1ec-28700c748cfb', '05b5e075-05c0-47ab-9583-d8fb0180fb7b', '31ecc77b-920d-493c-86ed-94521df7c92a', 'f6fdabe9-7aa7-4bcb-89a1-b87a6db96527'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:26 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:03:26 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:26 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:03:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Deleted volume successfully. Sep 07 11:03:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fe8c974-8006-4272-8443-dbdb8cf8b480 tempest-VolumesActionsTest-8769867 None] Lock "cinder-e1fec9ad-9b49-48f3-83b0-5d0319f340fe-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Flow 'volume_create_manager' (585e9837-a481-4262-8df5-8a1203c97e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b45794-760d-4b7a-b2d3-7c024bc19e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b45794-760d-4b7a-b2d3-7c024bc19e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-797285914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32e3ca0-8ef8-46f2-a09a-74018140ccc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f210529f7a444519a3c90348e1a48234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:34Z,use_quota=True,user_id='201f8ba4eb7647c19a81f3c25cea0236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c988e0f1-4219-41f9-9c23-cfd320149577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c988e0f1-4219-41f9-9c23-cfd320149577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99019ea-74d6-46f1-8ef8-ba32b3c71153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99019ea-74d6-46f1-8ef8-ba32b3c71153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32e3ca0-8ef8-46f2-a09a-74018140ccc5', 'volume_name': 'volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0808d0be-a3c5-439a-9cc9-4eb4c2922704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0808d0be-a3c5-439a-9cc9-4eb4c2922704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17ff5e6-0890-4253-b7c7-8df2a1fc525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:33 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Volume f32e3ca0-8ef8-46f2-a09a-74018140ccc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5', 'volume_size': 1} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-797285914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32e3ca0-8ef8-46f2-a09a-74018140ccc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f210529f7a444519a3c90348e1a48234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:34Z,use_quota=True,user_id='201f8ba4eb7647c19a81f3c25cea0236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Creating volume f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:03:33 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:03:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:33 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 1073741824 Sep 07 11:03:33 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:34 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 1073741824" returned: 0 in 0.388s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:34 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 Sep 07 11:03:34 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:34 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" returned: 0 in 0.236s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17ff5e6-0890-4253-b7c7-8df2a1fc525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0515c3-36ba-440b-b650-3b8a76169e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:34 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Volume volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 (f32e3ca0-8ef8-46f2-a09a-74018140ccc5): created successfully Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0515c3-36ba-440b-b650-3b8a76169e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Flow 'volume_create_manager' (585e9837-a481-4262-8df5-8a1203c97e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-59290885-e455-4309-9d08-fe5fa17b4aa2 tempest-VolumesCloneTest-455174685 None] Created volume successfully. Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Flow 'volume_create_manager' (7700b8e8-0703-4aa4-aa29-ff4992499537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47e84d3-b54c-48de-8940-4f92bd4d5e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47e84d3-b54c-48de-8940-4f92bd4d5e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1772186948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabc15b7-a13c-4663-822e-972b81a8995e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f210529f7a444519a3c90348e1a48234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f32e3ca0-8ef8-46f2-a09a-74018140ccc5,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:35Z,use_quota=True,user_id='201f8ba4eb7647c19a81f3c25cea0236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11433d3-47b2-42aa-bf10-857deb49857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11433d3-47b2-42aa-bf10-857deb49857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c51bdcf-86de-4b71-82e7-31626281c01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c51bdcf-86de-4b71-82e7-31626281c01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fabc15b7-a13c-4663-822e-972b81a8995e', 'volume_name': 'volume-fabc15b7-a13c-4663-822e-972b81a8995e', 'volume_size': 2, 'source_volid': 'f32e3ca0-8ef8-46f2-a09a-74018140ccc5', 'source_volstatus': 'available'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1f3c78-29b9-43d7-815c-9533be56e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1f3c78-29b9-43d7-815c-9533be56e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c51512-6b46-4872-9041-63d58e48d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Volume fabc15b7-a13c-4663-822e-972b81a8995e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fabc15b7-a13c-4663-822e-972b81a8995e', 'volume_size': 2, 'source_volid': 'f32e3ca0-8ef8-46f2-a09a-74018140ccc5', 'source_volstatus': 'available'} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:35 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Cloning volume f32e3ca0-8ef8-46f2-a09a-74018140ccc5 to volume fabc15b7-a13c-4663-822e-972b81a8995e Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Creating offline snapshot b8d8f694-5c0a-427a-8e9f-88e69a1af559 of volume f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fdc656-bfc4-4d6c-b0f4-e912abcfd93a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:35 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 Sep 07 11:03:35 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:35 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" returned: 0 in 0.353s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:35 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 1G Sep 07 11:03:35 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:36 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 1G" returned: 0 in 0.365s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:36 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 Sep 07 11:03:36 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:36 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 is being set with open permissions: ugo+rw Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:36 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 Sep 07 11:03:36 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:36 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559" returned: 0 in 0.264s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:36 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.info Sep 07 11:03:36 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:36 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.info" returned: 0 in 0.251s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.info is being set with open permissions: ugo+rw Sep 07 11:03:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:36 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.info Sep 07 11:03:36 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:37 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.info" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Acquiring lock "cinder-quobyte-fabc15b7-a13c-4663-822e-972b81a8995e" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-fabc15b7-a13c-4663-822e-972b81a8995e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] snapshot: b8d8f694-5c0a-427a-8e9f-88e69a1af559, volume: fabc15b7-a13c-4663-822e-972b81a8995e, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1340ee19-ad1a-40cd-95b3-15683f7a8c31]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:37 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 Sep 07 11:03:37 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:37 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559" returned: 0 in 0.353s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae34b6c3-4c5c-4ea0-bcb0-c172adec10d4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:37 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 Sep 07 11:03:37 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:37 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:03:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:37 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e Sep 07 11:03:37 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:41 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e" returned: 0 in 4.022s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:41 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5, size 1024.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:03:41 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Converted 1024.00 MB image at 254.54 MB/s Sep 07 11:03:41 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e is being set with open permissions: ugo+rw Sep 07 11:03:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:41 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e Sep 07 11:03:41 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:42 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e" returned: 0 in 0.234s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-fabc15b7-a13c-4663-822e-972b81a8995e" released by "_copy_volume_from_snapshot" :: held 5.007s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Acquiring lock "cinder-quobyte-b8d8f694-5c0a-427a-8e9f-88e69a1af559" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-b8d8f694-5c0a-427a-8e9f-88e69a1af559" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Deleting offline snapshot b8d8f694-5c0a-427a-8e9f-88e69a1af559 of volume f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] snapshot_file for this snap is: volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3d160-0760-469e-9210-bab364a02969]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:42 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 Sep 07 11:03:42 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:42 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559" returned: 0 in 0.342s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbc6e5a-03df-4165-b4d0-0c967d808d23]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:42 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 Sep 07 11:03:42 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:43 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" returned: 0 in 0.522s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:43 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 Sep 07 11:03:43 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:43 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:43 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559 Sep 07 11:03:43 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:43 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5.b8d8f694-5c0a-427a-8e9f-88e69a1af559" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-b8d8f694-5c0a-427a-8e9f-88e69a1af559" released by "_delete_snapshot" :: held 1.518s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.442s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c51512-6b46-4872-9041-63d58e48d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabc15b7-a13c-4663-822e-972b81a8995e', 'volume_size': 2, 'source_volid': 'f32e3ca0-8ef8-46f2-a09a-74018140ccc5', 'source_volstatus': 'available'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44feb880-cbb7-4eee-856d-58ec81a7bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:43 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Volume volume-fabc15b7-a13c-4663-822e-972b81a8995e (fabc15b7-a13c-4663-822e-972b81a8995e): created successfully Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44feb880-cbb7-4eee-856d-58ec81a7bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Flow 'volume_create_manager' (7700b8e8-0703-4aa4-aa29-ff4992499537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5a27d792-f9d6-4c71-a240-35b45d75d69b tempest-VolumesCloneTest-455174685 None] Created volume successfully. Sep 07 11:03:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Acquiring lock "cinder-fabc15b7-a13c-4663-822e-972b81a8995e-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Lock "cinder-fabc15b7-a13c-4663-822e-972b81a8995e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Acquiring lock "cinder-quobyte-fabc15b7-a13c-4663-822e-972b81a8995e" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-fabc15b7-a13c-4663-822e-972b81a8995e" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ca6677-8e5e-448e-91d6-8d4a4f6a25b8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:45 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e Sep 07 11:03:45 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:45 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e" returned: 0 in 0.355s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:45 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e Sep 07 11:03:45 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:45 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fabc15b7-a13c-4663-822e-972b81a8995e" returned: 0 in 0.267s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-fabc15b7-a13c-4663-822e-972b81a8995e" released by "delete_volume" :: held 0.660s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Created reservations ['299ee6f4-9193-4a74-af11-6b57720eeb76', '04f8e6f4-141c-42bf-a2c5-e202aa456aab', '79094d27-9e38-4341-aa53-686a4b7339f1', 'fed50039-7d57-4bcd-a58b-a47e8e1aa19e'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:45 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:03:45 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:45 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:45 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:03:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Deleted volume successfully. Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-955a4a54-4536-4e95-8b11-863a89c5d3b8 tempest-VolumesCloneTest-455174685 None] Lock "cinder-fabc15b7-a13c-4663-822e-972b81a8995e-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Acquiring lock "cinder-f32e3ca0-8ef8-46f2-a09a-74018140ccc5-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Lock "cinder-f32e3ca0-8ef8-46f2-a09a-74018140ccc5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Acquiring lock "cinder-quobyte-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cbdf3d-eb85-4b0e-a27b-50b6bda5aa81]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:46 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 Sep 07 11:03:46 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:46 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:46 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5 Sep 07 11:03:46 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:46 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Lock "cinder-quobyte-f32e3ca0-8ef8-46f2-a09a-74018140ccc5" released by "delete_volume" :: held 0.655s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Created reservations ['beecc8fd-b8ea-41e7-8247-34a5f2a4c42d', 'c01eb5a7-c0e2-49dd-a233-0e4d7851e836', '277e062b-3ea2-41a3-8afd-72d47c3798aa', '750ca828-24c7-466e-a011-415842235442'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:46 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:03:46 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:47 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.256s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:47 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:03:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Deleted volume successfully. Sep 07 11:03:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f89ec3a4-5e8b-46a2-ad4c-52ad7b5dfebf tempest-VolumesCloneTest-455174685 None] Lock "cinder-f32e3ca0-8ef8-46f2-a09a-74018140ccc5-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Flow 'volume_create_manager' (c42424ed-ec53-44c0-9a20-7177586ab87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39b1a67-cc2f-4e75-953e-c818e8789273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39b1a67-cc2f-4e75-953e-c818e8789273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-805994746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe6cb67-925d-4b16-8161-1eccb6422887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d095dd96c84e4b2ba9ba784963039f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:51Z,use_quota=True,user_id='338081f9d3d44238827ad7f63f60c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bfdba4-dd4f-4109-a5d8-42b92e42adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bfdba4-dd4f-4109-a5d8-42b92e42adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6efc39-ba24-4c4f-9ebf-9a9560b8968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6efc39-ba24-4c4f-9ebf-9a9560b8968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe6cb67-925d-4b16-8161-1eccb6422887', 'volume_name': 'volume-ebe6cb67-925d-4b16-8161-1eccb6422887', 'volume_size': 2}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f35be6-1f5a-40c4-8582-72f59bf61b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f35be6-1f5a-40c4-8582-72f59bf61b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50c5f2b-2ffe-4543-86ef-43991db71538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:50 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Volume ebe6cb67-925d-4b16-8161-1eccb6422887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe6cb67-925d-4b16-8161-1eccb6422887', 'volume_size': 2} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-805994746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe6cb67-925d-4b16-8161-1eccb6422887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d095dd96c84e4b2ba9ba784963039f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:51Z,use_quota=True,user_id='338081f9d3d44238827ad7f63f60c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Creating volume ebe6cb67-925d-4b16-8161-1eccb6422887 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:03:50 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:03:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 2147483648 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:50 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 2147483648 Sep 07 11:03:50 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:51 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 2147483648" returned: 0 in 0.431s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:51 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 Sep 07 11:03:51 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:51 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887" returned: 0 in 0.239s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50c5f2b-2ffe-4543-86ef-43991db71538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe6cb67-925d-4b16-8161-1eccb6422887', 'volume_size': 2}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5d03e7-b883-4cad-af96-8f7db41633f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:51 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Volume volume-ebe6cb67-925d-4b16-8161-1eccb6422887 (ebe6cb67-925d-4b16-8161-1eccb6422887): created successfully Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5d03e7-b883-4cad-af96-8f7db41633f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Flow 'volume_create_manager' (c42424ed-ec53-44c0-9a20-7177586ab87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7c38997e-b72d-46cd-be68-36f08fd60866 tempest-VolumesCloneNegativeTest-1579078880 None] Created volume successfully. Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Acquiring lock "cinder-ebe6cb67-925d-4b16-8161-1eccb6422887-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Lock "cinder-ebe6cb67-925d-4b16-8161-1eccb6422887-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Acquiring lock "cinder-quobyte-ebe6cb67-925d-4b16-8161-1eccb6422887" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Lock "cinder-quobyte-ebe6cb67-925d-4b16-8161-1eccb6422887" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbd2c80-7adf-4f04-baef-a5fe7d2e403d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:52 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 Sep 07 11:03:52 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:52 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887" returned: 0 in 0.369s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:52 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887 Sep 07 11:03:52 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:52 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ebe6cb67-925d-4b16-8161-1eccb6422887" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Lock "cinder-quobyte-ebe6cb67-925d-4b16-8161-1eccb6422887" released by "delete_volume" :: held 0.643s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Created reservations ['107b5479-b8ec-4cec-a7f4-5b19fcebfbaf', '321f8ac5-90a0-4eed-baff-16acc4f51c1f', 'abb94e2e-7e6f-4dce-b312-676499837cdb', '9f1546ca-310f-4897-b309-8a1582498c0e'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:52 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:03:52 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:52 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.241s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:03:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Deleted volume successfully. Sep 07 11:03:52 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-248c30be-abed-401f-8ecd-a5c8aa94f19c tempest-VolumesCloneNegativeTest-1579078880 None] Lock "cinder-ebe6cb67-925d-4b16-8161-1eccb6422887-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (81e39dab-a072-4c11-97c7-1df67c5a768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6551b44c-2c6f-4ce0-b1f8-9a68e32f5d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6551b44c-2c6f-4ce0-b1f8-9a68e32f5d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1408829817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c54cd4-dc9f-44d3-879e-b4e5b655ed83,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:56Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456eb4de-2f1d-41f9-b874-94d165b9d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456eb4de-2f1d-41f9-b874-94d165b9d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e81422-6f81-4613-99cb-2d4a5910e32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e81422-6f81-4613-99cb-2d4a5910e32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c54cd4-dc9f-44d3-879e-b4e5b655ed83', 'volume_name': 'volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb01b729-6e0a-4f50-b263-5d0827b6e1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb01b729-6e0a-4f50-b263-5d0827b6e1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a61e73f-83bb-467b-ba36-8990654d5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:56 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Volume 60c54cd4-dc9f-44d3-879e-b4e5b655ed83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83', 'volume_size': 1} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1408829817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c54cd4-dc9f-44d3-879e-b4e5b655ed83,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:56Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Creating volume 60c54cd4-dc9f-44d3-879e-b4e5b655ed83 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:03:56 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:56 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 1073741824 Sep 07 11:03:56 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:56 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 1073741824" returned: 0 in 0.398s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:57 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 Sep 07 11:03:57 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:57 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83" returned: 0 in 0.264s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a61e73f-83bb-467b-ba36-8990654d5831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0ea066-52c9-4502-bbaa-e00694850265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Volume volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 (60c54cd4-dc9f-44d3-879e-b4e5b655ed83): created successfully Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0ea066-52c9-4502-bbaa-e00694850265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (81e39dab-a072-4c11-97c7-1df67c5a768f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ccd9c91f-bad3-4887-9821-477eb1935e50 tempest-VolumesGetTest-2009191943 None] Created volume successfully. Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (94e86283-ffc7-4192-94cc-87ed870ffc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8035466-356f-4c36-b9ea-a03f42d6b806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8035466-356f-4c36-b9ea-a03f42d6b806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-343050385',display_name='tempest-VolumesGetTest-Volume-35953029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbe0abf-1a89-4eab-b0a0-ab7c01343de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:58Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df993c6f-e65c-410e-9598-c80697c945a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df993c6f-e65c-410e-9598-c80697c945a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aebcf56-51f2-470b-bb1e-661b2cc5bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aebcf56-51f2-470b-bb1e-661b2cc5bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfbe0abf-1a89-4eab-b0a0-ab7c01343de7', 'volume_name': 'volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b7d226-2389-4d6c-8482-433c177e8451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b7d226-2389-4d6c-8482-433c177e8451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f4ae38-4133-4ddf-9c7d-81c4df6f6401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:58 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Volume dfbe0abf-1a89-4eab-b0a0-ab7c01343de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7', 'volume_size': 1} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:03:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-343050385',display_name='tempest-VolumesGetTest-Volume-35953029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbe0abf-1a89-4eab-b0a0-ab7c01343de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:03:58Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Creating volume dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:03:58 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:58 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 1073741824 Sep 07 11:03:58 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:58 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 1073741824" returned: 0 in 0.410s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:58 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 Sep 07 11:03:58 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:58 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7" returned: 0 in 0.238s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:03:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f4ae38-4133-4ddf-9c7d-81c4df6f6401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89175d94-6ddf-4513-956b-5a8d4cba3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:03:59 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Volume volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 (dfbe0abf-1a89-4eab-b0a0-ab7c01343de7): created successfully Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89175d94-6ddf-4513-956b-5a8d4cba3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (94e86283-ffc7-4192-94cc-87ed870ffc52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:03:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6e167988-768f-4215-ad0a-fd2c3157f027 tempest-VolumesGetTest-2009191943 None] Created volume successfully. Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Lock "cinder-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62e4054-f55e-49e3-ba76-542ae30e264c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:59 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 Sep 07 11:03:59 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:03:59 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7" returned: 0 in 0.353s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:03:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:03:59 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7 Sep 07 11:03:59 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:00 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7" released by "delete_volume" :: held 0.638s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Created reservations ['0c7efda8-8cce-4a8f-a3d7-5eaf5b1c71bf', '4899b848-0d95-4cae-892f-952704821288', 'dd916c0a-84a2-4588-9a0e-2f86a70a0676', '870cf6e8-5980-44a5-91d6-562d636b6bd0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:00 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:00 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:00 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.241s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Deleted volume successfully. Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-44726fc1-e9e6-43fe-9ff1-e57b2955ee4e tempest-VolumesGetTest-2009191943 None] Lock "cinder-dfbe0abf-1a89-4eab-b0a0-ab7c01343de7-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-60c54cd4-dc9f-44d3-879e-b4e5b655ed83-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Lock "cinder-60c54cd4-dc9f-44d3-879e-b4e5b655ed83-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-60c54cd4-dc9f-44d3-879e-b4e5b655ed83" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-60c54cd4-dc9f-44d3-879e-b4e5b655ed83" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c4438-8b77-466a-8143-a0eca448f24d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:00 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 Sep 07 11:04:00 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:01 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83" returned: 0 in 0.362s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:01 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83 Sep 07 11:04:01 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:01 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60c54cd4-dc9f-44d3-879e-b4e5b655ed83" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-60c54cd4-dc9f-44d3-879e-b4e5b655ed83" released by "delete_volume" :: held 0.650s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Created reservations ['bf86383d-ab51-4788-996a-0a8577ce183a', '20727ed1-50df-44c7-b829-13ee2fb7b6ab', 'c178bbd8-752a-4807-ac5a-9b597988272f', '457f7dbf-6cf2-4372-bdc0-0ee378498e80'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:01 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:01 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:01 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Deleted volume successfully. Sep 07 11:04:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1abe059d-cfa5-4713-95ba-d9ef0053589d tempest-VolumesGetTest-2009191943 None] Lock "cinder-60c54cd4-dc9f-44d3-879e-b4e5b655ed83-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (572d3b7e-caa8-4bba-8dd2-30b043cb7128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b559c4e9-9598-46d1-bade-07e413d54da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b559c4e9-9598-46d1-bade-07e413d54da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-351776059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c20a55-3d86-4099-bf2d-2f84125f3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:02Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e461b-b599-4c1c-95f8-75b03d50a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e461b-b599-4c1c-95f8-75b03d50a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b217a3-2da2-4960-97f1-627981334c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b217a3-2da2-4960-97f1-627981334c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c20a55-3d86-4099-bf2d-2f84125f3784', 'volume_name': 'volume-73c20a55-3d86-4099-bf2d-2f84125f3784', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7660f55-8ecf-4222-b70f-5681efcb2509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7660f55-8ecf-4222-b70f-5681efcb2509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2998ef-c996-459a-ae47-d58ca24b2876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Volume 73c20a55-3d86-4099-bf2d-2f84125f3784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c20a55-3d86-4099-bf2d-2f84125f3784', 'volume_size': 1} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-351776059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c20a55-3d86-4099-bf2d-2f84125f3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:02Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Creating volume 73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:04:02 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:02 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 1073741824 Sep 07 11:04:02 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:02 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 1073741824" returned: 0 in 0.391s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:02 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 Sep 07 11:04:02 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:02 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784" returned: 0 in 0.250s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2998ef-c996-459a-ae47-d58ca24b2876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c20a55-3d86-4099-bf2d-2f84125f3784', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad822eb2-e0c7-43e7-92e8-3a33f887116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Volume volume-73c20a55-3d86-4099-bf2d-2f84125f3784 (73c20a55-3d86-4099-bf2d-2f84125f3784): created successfully Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad822eb2-e0c7-43e7-92e8-3a33f887116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (572d3b7e-caa8-4bba-8dd2-30b043cb7128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e7fdf71b-a79e-4846-85f5-3f6a3ecbdc6e tempest-VolumesGetTest-2009191943 None] Created volume successfully. Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (c70de0de-f9c6-40a0-98c7-d3776be59bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05df443-d763-4e8f-ac97-afa1f8090b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05df443-d763-4e8f-ac97-afa1f8090b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-926950597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae921bb-83af-43f8-966d-727293674e43,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=73c20a55-3d86-4099-bf2d-2f84125f3784,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:04Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e799f35-715f-4e53-8bf2-4f7e50465c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e799f35-715f-4e53-8bf2-4f7e50465c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092e2c86-01de-4a9d-abbe-4a5085ee1299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092e2c86-01de-4a9d-abbe-4a5085ee1299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4ae921bb-83af-43f8-966d-727293674e43', 'volume_name': 'volume-4ae921bb-83af-43f8-966d-727293674e43', 'volume_size': 1, 'source_volid': '73c20a55-3d86-4099-bf2d-2f84125f3784', 'source_volstatus': 'available'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e6c00e-a70f-48df-9509-6ea14485ee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e6c00e-a70f-48df-9509-6ea14485ee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769f96ae-eb60-41fb-bf5f-adb7adff0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Volume 4ae921bb-83af-43f8-966d-727293674e43: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4ae921bb-83af-43f8-966d-727293674e43', 'volume_size': 1, 'source_volid': '73c20a55-3d86-4099-bf2d-2f84125f3784', 'source_volstatus': 'available'} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:03 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Cloning volume 73c20a55-3d86-4099-bf2d-2f84125f3784 to volume 4ae921bb-83af-43f8-966d-727293674e43 Sep 07 11:04:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Creating offline snapshot 835dce7b-fa26-4bb9-a764-198160d3c00f of volume 73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:04:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b93e4b1-2610-4f60-93dd-32716d881e74]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:04 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 Sep 07 11:04:04 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:04 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784" returned: 0 in 0.366s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:04 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f 1G Sep 07 11:04:04 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:04 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f 1G" returned: 0 in 0.392s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c20a55-3d86-4099-bf2d-2f84125f3784 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:04 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c20a55-3d86-4099-bf2d-2f84125f3784 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f Sep 07 11:04:04 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:05 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c20a55-3d86-4099-bf2d-2f84125f3784 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f" returned: 0 in 0.299s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:05 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f is being set with open permissions: ugo+rw Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:05 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f Sep 07 11:04:05 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:05 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f" returned: 0 in 0.253s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:05 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.info Sep 07 11:04:05 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:05 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.info" returned: 0 in 0.257s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:05 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.info is being set with open permissions: ugo+rw Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:05 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.info Sep 07 11:04:05 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:05 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.info" returned: 0 in 0.251s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-4ae921bb-83af-43f8-966d-727293674e43" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-4ae921bb-83af-43f8-966d-727293674e43" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] snapshot: 835dce7b-fa26-4bb9-a764-198160d3c00f, volume: 4ae921bb-83af-43f8-966d-727293674e43, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44965e7-4811-4c42-955b-02c6fc619722]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:06 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f Sep 07 11:04:06 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:06 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c20a55-3d86-4099-bf2d-2f84125f3784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf2f2d3-378f-4d4f-879d-99970d702179]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:06 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 Sep 07 11:04:06 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:06 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784" returned: 0 in 0.364s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:04:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:06 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 Sep 07 11:04:06 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:10 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:10 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:10 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43" returned: 0 in 4.069s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:04:10 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Converted 1024.00 MB image at 251.57 MB/s Sep 07 11:04:10 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 is being set with open permissions: ugo+rw Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:10 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 Sep 07 11:04:10 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:10 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.277s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:04:10 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-4ae921bb-83af-43f8-966d-727293674e43" released by "_copy_volume_from_snapshot" :: held 5.093s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:10 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=71,cinder:SELECT=51,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-835dce7b-fa26-4bb9-a764-198160d3c00f" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-835dce7b-fa26-4bb9-a764-198160d3c00f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Deleting offline snapshot 835dce7b-fa26-4bb9-a764-198160d3c00f of volume 73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] snapshot_file for this snap is: volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d269890-082d-45ba-8890-0dcbaaf18892]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:11 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f Sep 07 11:04:11 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:11 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f" returned: 0 in 0.372s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c20a55-3d86-4099-bf2d-2f84125f3784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2376c96a-a3ce-44ce-87ca-617ddc055a81]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:11 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 Sep 07 11:04:11 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:11 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784" returned: 0 in 0.527s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:12 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f Sep 07 11:04:12 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:12 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:12 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f Sep 07 11:04:12 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:12 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784.835dce7b-fa26-4bb9-a764-198160d3c00f" returned: 0 in 0.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-835dce7b-fa26-4bb9-a764-198160d3c00f" released by "_delete_snapshot" :: held 1.568s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=53,cinder:UPDATE=71,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.668s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769f96ae-eb60-41fb-bf5f-adb7adff0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae921bb-83af-43f8-966d-727293674e43', 'volume_size': 1, 'source_volid': '73c20a55-3d86-4099-bf2d-2f84125f3784', 'source_volstatus': 'available'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3eb1c2-b4d6-4efc-af89-da7ae6800721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Volume volume-4ae921bb-83af-43f8-966d-727293674e43 (4ae921bb-83af-43f8-966d-727293674e43): created successfully Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3eb1c2-b4d6-4efc-af89-da7ae6800721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (c70de0de-f9c6-40a0-98c7-d3776be59bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a59f0698-ce62-450c-bb04-e33185c50f39 tempest-VolumesGetTest-2009191943 None] Created volume successfully. Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (3458fe34-7b77-4c70-b605-28f827658e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6131f92-9a33-42f4-8bea-0affeb15e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6131f92-9a33-42f4-8bea-0affeb15e090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-574366499',display_name='tempest-VolumesGetTest-Volume-1264275656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54386cb-74d7-430a-84a7-ae1e9480871c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:14Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753bb54c-206a-4d26-8e1b-a7f4181a7691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753bb54c-206a-4d26-8e1b-a7f4181a7691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0779811-1363-469c-86fe-de6ee9374bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0779811-1363-469c-86fe-de6ee9374bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd54386cb-74d7-430a-84a7-ae1e9480871c', 'volume_name': 'volume-d54386cb-74d7-430a-84a7-ae1e9480871c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a39958b-b632-4215-83f2-1a4ff6a7dd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a39958b-b632-4215-83f2-1a4ff6a7dd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe102292-f65b-44b7-b055-5ce772c33da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:14 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Volume d54386cb-74d7-430a-84a7-ae1e9480871c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d54386cb-74d7-430a-84a7-ae1e9480871c', 'volume_size': 1} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-574366499',display_name='tempest-VolumesGetTest-Volume-1264275656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54386cb-74d7-430a-84a7-ae1e9480871c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:14Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Creating volume d54386cb-74d7-430a-84a7-ae1e9480871c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:04:14 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:14 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c 1073741824 Sep 07 11:04:14 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:14 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c 1073741824" returned: 0 in 0.414s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:14 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c Sep 07 11:04:14 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:14 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c" returned: 0 in 0.250s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe102292-f65b-44b7-b055-5ce772c33da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d54386cb-74d7-430a-84a7-ae1e9480871c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8e450e-30ed-4360-a216-fc88c49063f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:14 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Volume volume-d54386cb-74d7-430a-84a7-ae1e9480871c (d54386cb-74d7-430a-84a7-ae1e9480871c): created successfully Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8e450e-30ed-4360-a216-fc88c49063f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (3458fe34-7b77-4c70-b605-28f827658e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5a577d7b-936f-4337-a4e5-77333a772613 tempest-VolumesGetTest-2009191943 None] Created volume successfully. Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-d54386cb-74d7-430a-84a7-ae1e9480871c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Lock "cinder-d54386cb-74d7-430a-84a7-ae1e9480871c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-d54386cb-74d7-430a-84a7-ae1e9480871c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-d54386cb-74d7-430a-84a7-ae1e9480871c" acquired by "delete_volume" :: waited 0.012s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[85659295-1b05-4b30-963a-e2323661a3ea]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:15 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c Sep 07 11:04:15 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:15 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c" returned: 0 in 0.381s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:15 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c Sep 07 11:04:15 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:15 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d54386cb-74d7-430a-84a7-ae1e9480871c" returned: 0 in 0.258s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-d54386cb-74d7-430a-84a7-ae1e9480871c" released by "delete_volume" :: held 0.677s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:15 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Created reservations ['f0873dcf-ae7e-48a7-8699-e724c63e89a3', 'c0c78057-b30f-422e-95b6-16c401cda698', '5e77b04a-afe3-4b1f-9a35-89d1502e5ab7', '8a6b571c-c634-46be-8677-6fa63d3bd0d8'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:16 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:16 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:16 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Deleted volume successfully. Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d99fa0f3-d12d-4175-8a7a-70814e98e95f tempest-VolumesGetTest-2009191943 None] Lock "cinder-d54386cb-74d7-430a-84a7-ae1e9480871c-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-4ae921bb-83af-43f8-966d-727293674e43-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Lock "cinder-4ae921bb-83af-43f8-966d-727293674e43-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-4ae921bb-83af-43f8-966d-727293674e43" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-4ae921bb-83af-43f8-966d-727293674e43" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[852de24a-5142-454d-b7b7-b00c6eb86dde]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:16 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 Sep 07 11:04:16 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:16 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43" returned: 0 in 0.355s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:16 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43 Sep 07 11:04:16 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:17 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4ae921bb-83af-43f8-966d-727293674e43" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-4ae921bb-83af-43f8-966d-727293674e43" released by "delete_volume" :: held 0.663s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Created reservations ['e25b78d8-f8d3-4fdf-bf78-998545e2a2bd', '77bdfc75-a9b3-462f-833d-1b9c290f4b62', '4a156435-75cd-44db-9748-246d5e1ef3d7', '6b6ebdf5-b67b-43ce-844b-f7fddf6c49d4'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:17 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:17 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:17 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Deleted volume successfully. Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-bda9600b-17f4-4cb0-950b-de62f8de80e9 tempest-VolumesGetTest-2009191943 None] Lock "cinder-4ae921bb-83af-43f8-966d-727293674e43-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-73c20a55-3d86-4099-bf2d-2f84125f3784-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Lock "cinder-73c20a55-3d86-4099-bf2d-2f84125f3784-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-73c20a55-3d86-4099-bf2d-2f84125f3784" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-73c20a55-3d86-4099-bf2d-2f84125f3784" acquired by "delete_volume" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b37dc61-63cc-497b-b5d6-97297bdc0c52]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:17 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 Sep 07 11:04:17 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:18 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784" returned: 0 in 0.349s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:18 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784 Sep 07 11:04:18 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:18 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-73c20a55-3d86-4099-bf2d-2f84125f3784" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-73c20a55-3d86-4099-bf2d-2f84125f3784" released by "delete_volume" :: held 0.657s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Created reservations ['62b4d9c7-92db-4332-bb87-35811b0835a6', '1782df4f-2097-451a-a816-7c3401f55627', '35fb2e85-40de-41c1-a367-06323b10bfb4', 'abf5b97b-1908-4498-8f7a-627009c56f85'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:18 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:18 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:18 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.263s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Deleted volume successfully. Sep 07 11:04:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9c411673-7bd3-4e1e-ba61-5db598cc71f3 tempest-VolumesGetTest-2009191943 None] Lock "cinder-73c20a55-3d86-4099-bf2d-2f84125f3784-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (1342bb30-fc44-40b5-aec4-379b521aec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fba58db-358d-4508-8c41-4840f8cc16ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fba58db-358d-4508-8c41-4840f8cc16ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1796653426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb6b697-6d71-437c-ba95-09c43e1b5952,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:19Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad918245-7db8-4384-8fa4-e49143a87888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad918245-7db8-4384-8fa4-e49143a87888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79755a3d-9878-4bf9-b740-c243d5184727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79755a3d-9878-4bf9-b740-c243d5184727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8cb6b697-6d71-437c-ba95-09c43e1b5952', 'volume_name': 'volume-8cb6b697-6d71-437c-ba95-09c43e1b5952', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276ab92e-036a-4f8c-a754-219258009558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276ab92e-036a-4f8c-a754-219258009558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bae48e-c97d-43e4-879b-406dcaa17395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Volume 8cb6b697-6d71-437c-ba95-09c43e1b5952: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8cb6b697-6d71-437c-ba95-09c43e1b5952', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 11:04:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Trying to clone 8cb6b697-6d71-437c-ba95-09c43e1b5952 from image 705abe21-5cec-4130-9cb9-f60544709b95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 11:04:20 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Image download 20.69 MB at 20.69 MB/s Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4580ff-0ed3-41fa-b63a-deeac8e6e20c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:20 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD Sep 07 11:04:20 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:20 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 is fetched for user 8a5adbf1e8394deb81dc3efcb45c367c. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f58975-42bc-4789-b446-9e7546ded838]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:20 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD Sep 07 11:04:20 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:20 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1796653426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb6b697-6d71-437c-ba95-09c43e1b5952,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:19Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Creating volume 8cb6b697-6d71-437c-ba95-09c43e1b5952 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:04:20 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:04:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:20 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 1073741824 Sep 07 11:04:20 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:21 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 1073741824" returned: 0 in 0.414s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:21 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 Sep 07 11:04:21 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:21 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952" returned: 0 in 0.253s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Attempting download of 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume 8cb6b697-6d71-437c-ba95-09c43e1b5952. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c85bfe9-f527-478c-b0a1-2c9b4554c5eb]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_0y7_nyo0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:21 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_0y7_nyo0 Sep 07 11:04:21 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:22 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_0y7_nyo0" returned: 0 in 0.347s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_0y7_nyo0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:22 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_0y7_nyo0 Sep 07 11:04:22 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:22 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_0y7_nyo0" returned: 1 in 0.327s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705abe21-5cec-4130-9cb9-f60544709b95_0y7_nyo0' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab9fd48-ff93-4814-a84c-76edcb7c3185]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:22 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD Sep 07 11:04:22 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:22 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] 705abe21-5cec-4130-9cb9-f60544709b95 was qcow2, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 11:04:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:22 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 Sep 07 11:04:22 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:24 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952" returned: 0 in 1.599s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_705abe21-5cec-4130-9cb9-f60544709b95_0vz7k5o6devstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:04:24 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Converted 112.00 MB image at 70.00 MB/s Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:24 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 1G Sep 07 11:04:24 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:24 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 1G" returned: 0 in 0.324s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Downloaded image 705abe21-5cec-4130-9cb9-f60544709b95 ((None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}])) to volume 8cb6b697-6d71-437c-ba95-09c43e1b5952 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Temporary image 705abe21-5cec-4130-9cb9-f60544709b95 for user 8a5adbf1e8394deb81dc3efcb45c367c is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Marking volume 8cb6b697-6d71-437c-ba95-09c43e1b5952 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Copying metadata from image 705abe21-5cec-4130-9cb9-f60544709b95 to 8cb6b697-6d71-437c-ba95-09c43e1b5952. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Creating volume glance metadata for volume 8cb6b697-6d71-437c-ba95-09c43e1b5952 backed by image 705abe21-5cec-4130-9cb9-f60544709b95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bae48e-c97d-43e4-879b-406dcaa17395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb6b697-6d71-437c-ba95-09c43e1b5952', 'volume_size': 1, 'image_id': '705abe21-5cec-4130-9cb9-f60544709b95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705abe21-5cec-4130-9cb9-f60544709b95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c5e2f259dc894518a790b3c56f9972ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '705abe21-5cec-4130-9cb9-f60544709b95', 'created_at': datetime.datetime(2026, 9, 7, 8, 42, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 42, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705abe21-5cec-4130-9cb9-f60544709b95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5e87ab-8ef7-4e1e-b77c-b6ca2f8b464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Volume volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 (8cb6b697-6d71-437c-ba95-09c43e1b5952): created successfully Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5e87ab-8ef7-4e1e-b77c-b6ca2f8b464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (1342bb30-fc44-40b5-aec4-379b521aec3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5482fd09-48e7-4324-a330-71f0e50a4635 tempest-VolumesGetTest-2009191943 None] Created volume successfully. Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (8c393984-f02d-454c-845c-f41f012acb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe83b31-4268-4767-afa0-023675ccced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe83b31-4268-4767-afa0-023675ccced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2016016362',display_name='tempest-VolumesGetTest-Volume-804956565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbfb236d-bf39-49b9-9621-47d748cf000d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:26Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32db0f23-27af-4033-94c6-e54562b0f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32db0f23-27af-4033-94c6-e54562b0f191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3c86ac-3fbb-4ce6-818b-c689843f1373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3c86ac-3fbb-4ce6-818b-c689843f1373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbfb236d-bf39-49b9-9621-47d748cf000d', 'volume_name': 'volume-dbfb236d-bf39-49b9-9621-47d748cf000d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84aec61c-dcae-45c6-96f1-0dc75e16f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84aec61c-dcae-45c6-96f1-0dc75e16f011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da91d77-936a-4c8c-8fb5-ea8c96015375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:26 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Volume dbfb236d-bf39-49b9-9621-47d748cf000d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbfb236d-bf39-49b9-9621-47d748cf000d', 'volume_size': 1} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2016016362',display_name='tempest-VolumesGetTest-Volume-804956565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbfb236d-bf39-49b9-9621-47d748cf000d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b9d7291ef94e718661b96fda9072ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:26Z,use_quota=True,user_id='8a5adbf1e8394deb81dc3efcb45c367c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Creating volume dbfb236d-bf39-49b9-9621-47d748cf000d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:04:26 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:26 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d 1073741824 Sep 07 11:04:26 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:26 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d 1073741824" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:26 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d Sep 07 11:04:26 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:27 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da91d77-936a-4c8c-8fb5-ea8c96015375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbfb236d-bf39-49b9-9621-47d748cf000d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d28a906-cdec-4676-8c3b-5cdba932b8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:27 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Volume volume-dbfb236d-bf39-49b9-9621-47d748cf000d (dbfb236d-bf39-49b9-9621-47d748cf000d): created successfully Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d28a906-cdec-4676-8c3b-5cdba932b8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Flow 'volume_create_manager' (8c393984-f02d-454c-845c-f41f012acb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:27 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e18b2baa-e78e-4c25-a1e8-c6636b0d5367 tempest-VolumesGetTest-2009191943 None] Created volume successfully. Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-dbfb236d-bf39-49b9-9621-47d748cf000d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Lock "cinder-dbfb236d-bf39-49b9-9621-47d748cf000d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-dbfb236d-bf39-49b9-9621-47d748cf000d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-dbfb236d-bf39-49b9-9621-47d748cf000d" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc811cb-4c71-47ec-a289-7298db063a7b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:27 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d Sep 07 11:04:27 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:27 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d" returned: 0 in 0.349s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:28 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d Sep 07 11:04:28 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:28 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-dbfb236d-bf39-49b9-9621-47d748cf000d" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-dbfb236d-bf39-49b9-9621-47d748cf000d" released by "delete_volume" :: held 0.622s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Created reservations ['c136c057-4ed6-4e6a-aa5f-8a61aa1607d5', '2b334e5e-999f-41f4-a941-da0d9076eb1b', '4ef7ffd4-364f-49bc-8ee2-f441094f1670', '69f8bf3b-4256-4b52-a2ba-48bb91b8cb9b'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:28 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:28 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:28 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.238s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Deleted volume successfully. Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8331ffdc-6a4b-49ba-9458-4be7a5d59587 tempest-VolumesGetTest-2009191943 None] Lock "cinder-dbfb236d-bf39-49b9-9621-47d748cf000d-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-8cb6b697-6d71-437c-ba95-09c43e1b5952-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Lock "cinder-8cb6b697-6d71-437c-ba95-09c43e1b5952-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Acquiring lock "cinder-quobyte-8cb6b697-6d71-437c-ba95-09c43e1b5952" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-8cb6b697-6d71-437c-ba95-09c43e1b5952" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[489aa691-ade8-4395-a44a-bd208a20eb66]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:28 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 Sep 07 11:04:28 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:29 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952" returned: 0 in 0.346s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:29 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952 Sep 07 11:04:29 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:29 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8cb6b697-6d71-437c-ba95-09c43e1b5952" returned: 0 in 0.241s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Lock "cinder-quobyte-8cb6b697-6d71-437c-ba95-09c43e1b5952" released by "delete_volume" :: held 0.623s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Created reservations ['debd527d-6b12-4dc5-be07-259b297c1b0f', 'fd3ee613-eefd-4c1b-9c64-8f165e604aa9', 'fd220a19-9295-4130-9f50-df7d93b3dded', 'd79ccf48-9d66-400e-8ec7-afdeb96058c7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:29 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:29 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:29 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.246s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:29 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Deleted volume successfully. Sep 07 11:04:29 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2d7663c6-eed3-47b7-9277-6554809b472d tempest-VolumesGetTest-2009191943 None] Lock "cinder-8cb6b697-6d71-437c-ba95-09c43e1b5952-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Flow 'volume_create_manager' (9bf2bd5f-da48-453d-85c7-40ef7cd44302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96edb59-5e5a-4061-9a4f-d39768cb33d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96edb59-5e5a-4061-9a4f-d39768cb33d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-910709693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4634fbf6-9928-48b4-9e0a-5ee870cf9325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a763cbb4834a41a1bd026ea537299e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:37Z,use_quota=True,user_id='7357a28388da4d59adf871f18e3d37ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a819a9-1f8c-4249-9a98-b1f8130a2709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a819a9-1f8c-4249-9a98-b1f8130a2709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866926d8-40c9-4ac5-8fe4-11ad6297a772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866926d8-40c9-4ac5-8fe4-11ad6297a772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4634fbf6-9928-48b4-9e0a-5ee870cf9325', 'volume_name': 'volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c68bb19-dbfb-4e94-88fd-110f5d46e0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c68bb19-dbfb-4e94-88fd-110f5d46e0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03af72b0-0282-4d1a-8d09-cd4f85ff0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:36 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Volume 4634fbf6-9928-48b4-9e0a-5ee870cf9325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325', 'volume_size': 1} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-910709693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4634fbf6-9928-48b4-9e0a-5ee870cf9325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a763cbb4834a41a1bd026ea537299e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:04:37Z,use_quota=True,user_id='7357a28388da4d59adf871f18e3d37ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Creating volume 4634fbf6-9928-48b4-9e0a-5ee870cf9325 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:04:36 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:04:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:37 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 1073741824 Sep 07 11:04:37 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:37 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 1073741824" returned: 0 in 0.439s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:37 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 Sep 07 11:04:37 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:37 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03af72b0-0282-4d1a-8d09-cd4f85ff0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99293788-9ff5-4cb2-883a-a76f3cf153a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:04:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Volume volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 (4634fbf6-9928-48b4-9e0a-5ee870cf9325): created successfully Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99293788-9ff5-4cb2-883a-a76f3cf153a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:04:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Flow 'volume_create_manager' (9bf2bd5f-da48-453d-85c7-40ef7cd44302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:04:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f8255c13-ec67-4909-98af-70ff2c3bcb8a tempest-VolumesNegativeTest-1484331666 None] Created volume successfully. Sep 07 11:04:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:DELETE=4,cinder:SELECT=47,cinder:UPDATE=54,cinder:INSERT=20 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:04:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=58,cinder:SELECT=36,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Acquiring lock "cinder-4634fbf6-9928-48b4-9e0a-5ee870cf9325-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Lock "cinder-4634fbf6-9928-48b4-9e0a-5ee870cf9325-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Acquiring lock "cinder-quobyte-4634fbf6-9928-48b4-9e0a-5ee870cf9325" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Lock "cinder-quobyte-4634fbf6-9928-48b4-9e0a-5ee870cf9325" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c3719c-4734-4d22-9c9a-d5e13955042f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:54 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 Sep 07 11:04:54 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:54 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325" returned: 0 in 0.381s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:54 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325 Sep 07 11:04:54 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:54 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4634fbf6-9928-48b4-9e0a-5ee870cf9325" returned: 0 in 0.250s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Lock "cinder-quobyte-4634fbf6-9928-48b4-9e0a-5ee870cf9325" released by "delete_volume" :: held 0.670s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Created reservations ['157f6a66-d718-41f1-9ee1-9f863f0719ea', 'c2bc9fb5-05ff-4a6a-84a8-f06af30caf54', '4825194c-3242-4229-8ee2-0bab5c3d1c92', '6837ef4c-3880-4f16-94c7-2c983b6ca30c'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:04:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:04:54 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:04:54 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:04:55 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Sep 07 11:04:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:04:55 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:04:55 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Deleted volume successfully. Sep 07 11:04:55 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8b15c63-ce99-436d-84ed-2ebe1a941545 tempest-VolumesNegativeTest-1484331666 None] Lock "cinder-4634fbf6-9928-48b4-9e0a-5ee870cf9325-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:04 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:05:05 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (ad3c5902-23af-4d76-a622-1b6229637074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4f2912-a622-4672-9b0b-c8a7fcb4f759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4f2912-a622-4672-9b0b-c8a7fcb4f759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-382686860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:06Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3840297-4b4e-4b11-a7f6-4457b803886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3840297-4b4e-4b11-a7f6-4457b803886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03745f3c-95fb-4a0f-9aa2-9228b6515505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03745f3c-95fb-4a0f-9aa2-9228b6515505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb', 'volume_name': 'volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122deb83-4be8-4a6d-9391-54a913056ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122deb83-4be8-4a6d-9391-54a913056ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88239e1-12e7-47a9-a481-2f45b58d59c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:06 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb', 'volume_size': 1} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-382686860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:06Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating volume a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:05:06 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:06 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb 1073741824 Sep 07 11:05:06 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:06 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb 1073741824" returned: 0 in 0.404s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:06 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb Sep 07 11:05:06 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:07 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88239e1-12e7-47a9-a481-2f45b58d59c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069fb6e8-750e-4236-82d0-a8fec734a800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:07 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb (a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb): created successfully Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069fb6e8-750e-4236-82d0-a8fec734a800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (ad3c5902-23af-4d76-a622-1b6229637074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-28314de2-5b1e-489a-ae31-a23c89dad0b9 tempest-VolumesSnapshotTestJSON-2109059522 None] Created volume successfully. Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating offline snapshot 5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 of volume a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f620ec-7b16-408f-bd1b-8ff9ceb534f4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:07 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb Sep 07 11:05:07 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:08 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" returned: 0 in 0.355s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:08 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 1G Sep 07 11:05:08 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:08 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 1G" returned: 0 in 0.421s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:08 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 Sep 07 11:05:08 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:08 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" returned: 0 in 0.298s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:08 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 is being set with open permissions: ugo+rw Sep 07 11:05:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:08 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 Sep 07 11:05:08 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:09 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" returned: 0 in 0.256s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:09 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.info Sep 07 11:05:09 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:09 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.info" returned: 0 in 0.259s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:09 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.info is being set with open permissions: ugo+rw Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:09 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.info Sep 07 11:05:09 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:09 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.info" returned: 0 in 0.255s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:09 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2b2fe117-d1f7-4f0a-9f8d-35f41cd79133 tempest-VolumesSnapshotTestJSON-2109059522 None] Create snapshot completed successfully Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-5a54f0ef-a79a-4c4f-a01a-62460fd14ba9-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-5a54f0ef-a79a-4c4f-a01a-62460fd14ba9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Deleting offline snapshot 5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 of volume a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] snapshot_file for this snap is: volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a73d824-ce08-4a1a-b1d1-a8488f414e37]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:10 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 Sep 07 11:05:10 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:10 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" returned: 0 in 0.366s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e4e999-7391-4c23-bdaa-27f5faa60fe2]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:10 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb Sep 07 11:05:10 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:10 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:05:10 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:10 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:10 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 Sep 07 11:05:10 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:10 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.261s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:05:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:05:11 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:11 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9 Sep 07 11:05:11 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:11 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb.5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" returned: 0 in 0.240s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-5a54f0ef-a79a-4c4f-a01a-62460fd14ba9" released by "_delete_snapshot" :: held 1.407s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" released by "delete_snapshot" :: held 1.429s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:11 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['c62bdf72-17de-4811-b6b7-71156011022f', '46252538-d2a4-4c8d-84cb-155678fea349', '272d7b6d-f7d0-44b3-b681-ad57bca46143', '7e46d1bf-d267-4507-8a58-07431725b941'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Delete snapshot completed successfully. Sep 07 11:05:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-13d64461-03cd-4bb9-8cd6-946705bec24b tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-5a54f0ef-a79a-4c4f-a01a-62460fd14ba9-delete_snapshot" released by "delete_snapshot" :: held 1.587s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (8f58140e-c65f-4039-92e4-a3407e9f3231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b759194c-5a2b-4898-9f9f-4436f8cc963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b759194c-5a2b-4898-9f9f-4436f8cc963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1302200422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acab800-cccd-4e00-86d7-b9478ad17bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:13Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebbcf9f-fb6c-4f7f-9b34-5f1398e91b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebbcf9f-fb6c-4f7f-9b34-5f1398e91b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e5e5a-6c7b-4d12-85ce-37f05655e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e5e5a-6c7b-4d12-85ce-37f05655e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2acab800-cccd-4e00-86d7-b9478ad17bdc', 'volume_name': 'volume-2acab800-cccd-4e00-86d7-b9478ad17bdc', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f0f4ba-71e3-400e-b5b2-52839929cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f0f4ba-71e3-400e-b5b2-52839929cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c2e0ed-18d4-442a-a999-1bca854a9db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Volume 2acab800-cccd-4e00-86d7-b9478ad17bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2acab800-cccd-4e00-86d7-b9478ad17bdc', 'volume_size': 1} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1302200422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acab800-cccd-4e00-86d7-b9478ad17bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:13Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Creating volume 2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:05:12 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:05:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:12 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc 1073741824 Sep 07 11:05:12 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:13 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc 1073741824" returned: 0 in 0.393s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:13 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc Sep 07 11:05:13 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:13 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc" returned: 0 in 0.238s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c2e0ed-18d4-442a-a999-1bca854a9db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2acab800-cccd-4e00-86d7-b9478ad17bdc', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e230fb9d-8b68-4d07-b390-38cdfbf7f026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:13 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Volume volume-2acab800-cccd-4e00-86d7-b9478ad17bdc (2acab800-cccd-4e00-86d7-b9478ad17bdc): created successfully Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e230fb9d-8b68-4d07-b390-38cdfbf7f026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (8f58140e-c65f-4039-92e4-a3407e9f3231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e6de6760-ae17-4fa9-a1ad-6a9f5b4d7b0c tempest-VolumesSnapshotTestJSON-2109059522 None] Created volume successfully. Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating offline snapshot 420392fb-e686-478a-bfa3-0a03cabb547c of volume 2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e7516-5847-491d-b8e8-18bd0e31314f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:13 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc Sep 07 11:05:13 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:14 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc" returned: 0 in 0.350s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:14 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c 1G Sep 07 11:05:14 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:14 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c 1G" returned: 0 in 0.389s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2acab800-cccd-4e00-86d7-b9478ad17bdc -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:14 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2acab800-cccd-4e00-86d7-b9478ad17bdc -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c Sep 07 11:05:14 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:14 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2acab800-cccd-4e00-86d7-b9478ad17bdc -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c" returned: 0 in 0.284s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:14 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c is being set with open permissions: ugo+rw Sep 07 11:05:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:14 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c Sep 07 11:05:14 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:15 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c" returned: 0 in 0.242s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:15 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.info Sep 07 11:05:15 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:15 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.info" returned: 0 in 0.253s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:15 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.info is being set with open permissions: ugo+rw Sep 07 11:05:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:15 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.info Sep 07 11:05:15 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:15 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.info" returned: 0 in 0.260s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f64c18ad-61d6-4333-9574-386ec151fc66 tempest-VolumesSnapshotTestJSON-2109059522 None] Create snapshot completed successfully Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (8e807d5f-e08d-4e80-83c0-8c7f36350d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d23f2de-3215-417f-800e-73b0f0fb3f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d23f2de-3215-417f-800e-73b0f0fb3f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1834513554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbfd10a-0039-40b8-a440-8e1410d8606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=420392fb-e686-478a-bfa3-0a03cabb547c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:16Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2b36ce-e16d-440c-b4a1-1ab9331161c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2b36ce-e16d-440c-b4a1-1ab9331161c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5423e1e-c5d2-47de-942b-970e8b9e05dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5423e1e-c5d2-47de-942b-970e8b9e05dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cfbfd10a-0039-40b8-a440-8e1410d8606d', 'volume_name': 'volume-cfbfd10a-0039-40b8-a440-8e1410d8606d', 'volume_size': 2, 'snapshot_id': '420392fb-e686-478a-bfa3-0a03cabb547c'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3809322-54f5-4401-8a01-d8d0cf9120b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3809322-54f5-4401-8a01-d8d0cf9120b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99821e4e-eefd-4218-b72f-211f95cda45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:16 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume cfbfd10a-0039-40b8-a440-8e1410d8606d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cfbfd10a-0039-40b8-a440-8e1410d8606d', 'volume_size': 2, 'snapshot_id': '420392fb-e686-478a-bfa3-0a03cabb547c'} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-420392fb-e686-478a-bfa3-0a03cabb547c-cfbfd10a-0039-40b8-a440-8e1410d8606d" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-420392fb-e686-478a-bfa3-0a03cabb547c-cfbfd10a-0039-40b8-a440-8e1410d8606d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating volume cfbfd10a-0039-40b8-a440-8e1410d8606d from snapshot 420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-cfbfd10a-0039-40b8-a440-8e1410d8606d" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-cfbfd10a-0039-40b8-a440-8e1410d8606d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] snapshot: 420392fb-e686-478a-bfa3-0a03cabb547c, volume: cfbfd10a-0039-40b8-a440-8e1410d8606d, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6952976a-70d9-438a-8a6a-f74de6e7b0c9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:16 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c Sep 07 11:05:16 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:17 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c" returned: 0 in 0.366s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2acab800-cccd-4e00-86d7-b9478ad17bdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2449035b-9932-4133-9ce0-481c03bd419d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:17 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc Sep 07 11:05:17 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:17 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:05:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:17 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d Sep 07 11:05:17 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:21 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d" returned: 0 in 3.942s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:05:21 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Converted 1024.00 MB image at 259.68 MB/s Sep 07 11:05:21 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d is being set with open permissions: ugo+rw Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:21 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d Sep 07 11:05:21 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:21 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-cfbfd10a-0039-40b8-a440-8e1410d8606d" released by "_copy_volume_from_snapshot" :: held 4.998s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-420392fb-e686-478a-bfa3-0a03cabb547c-cfbfd10a-0039-40b8-a440-8e1410d8606d" released by "_create_volume_from_snapshot" :: held 5.056s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.071s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99821e4e-eefd-4218-b72f-211f95cda45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbfd10a-0039-40b8-a440-8e1410d8606d', 'volume_size': 2, 'snapshot_id': '420392fb-e686-478a-bfa3-0a03cabb547c'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5860553-ff13-4239-a3d1-b22e1fe625f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume volume-cfbfd10a-0039-40b8-a440-8e1410d8606d (cfbfd10a-0039-40b8-a440-8e1410d8606d): created successfully Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5860553-ff13-4239-a3d1-b22e1fe625f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (8e807d5f-e08d-4e80-83c0-8c7f36350d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d96d9670-135d-4839-8273-c7419c395be6 tempest-VolumesSnapshotTestJSON-2109059522 None] Created volume successfully. Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-cfbfd10a-0039-40b8-a440-8e1410d8606d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-cfbfd10a-0039-40b8-a440-8e1410d8606d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-cfbfd10a-0039-40b8-a440-8e1410d8606d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-cfbfd10a-0039-40b8-a440-8e1410d8606d" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d3244e-6876-488d-93e1-0c226cee352d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:22 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d Sep 07 11:05:22 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:22 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d" returned: 0 in 0.355s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:22 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d Sep 07 11:05:22 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:22 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cfbfd10a-0039-40b8-a440-8e1410d8606d" returned: 0 in 0.233s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-cfbfd10a-0039-40b8-a440-8e1410d8606d" released by "delete_volume" :: held 0.627s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['799a8b9d-bb6e-40b0-aa32-b578305eec08', '39585187-4e02-46ac-abe8-af69654a6bf7', '3d6595c6-c901-418b-8e42-1500e61f3d57', '18c729ee-ecae-4f76-8a8e-b7cd093326b3'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:22 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:05:22 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:23 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:05:23 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Deleted volume successfully. Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63346aea-862e-4d60-9e5b-cd4a56c01255 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-cfbfd10a-0039-40b8-a440-8e1410d8606d-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-420392fb-e686-478a-bfa3-0a03cabb547c-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-420392fb-e686-478a-bfa3-0a03cabb547c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-2acab800-cccd-4e00-86d7-b9478ad17bdc" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-2acab800-cccd-4e00-86d7-b9478ad17bdc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-420392fb-e686-478a-bfa3-0a03cabb547c" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-420392fb-e686-478a-bfa3-0a03cabb547c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Deleting offline snapshot 420392fb-e686-478a-bfa3-0a03cabb547c of volume 2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] snapshot_file for this snap is: volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[798980f0-99d1-458b-9133-7471faca0300]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:23 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c Sep 07 11:05:23 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:23 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c" returned: 0 in 0.352s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2acab800-cccd-4e00-86d7-b9478ad17bdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0401e4-9ad1-45c6-9a7f-8c0b3445e3d7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:23 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc Sep 07 11:05:23 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:24 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc" returned: 0 in 0.536s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:24 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c Sep 07 11:05:24 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:24 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c" returned: 0 in 0.321s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:24 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c Sep 07 11:05:24 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:24 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc.420392fb-e686-478a-bfa3-0a03cabb547c" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-420392fb-e686-478a-bfa3-0a03cabb547c" released by "_delete_snapshot" :: held 1.542s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-2acab800-cccd-4e00-86d7-b9478ad17bdc" released by "delete_snapshot" :: held 1.563s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['0227a72c-be0e-439b-956d-27c3e28ecc0d', '0bd70137-5006-4fc0-8e20-b6c3dbd33507', 'ee18df16-5996-4285-9026-be1372860410', '51f0bde5-a156-4bc8-95ca-dbbf71af56c6'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Delete snapshot completed successfully. Sep 07 11:05:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4322e8f1-e479-4cfe-aff8-7a3e608d11a3 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-420392fb-e686-478a-bfa3-0a03cabb547c-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-2acab800-cccd-4e00-86d7-b9478ad17bdc-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-2acab800-cccd-4e00-86d7-b9478ad17bdc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-2acab800-cccd-4e00-86d7-b9478ad17bdc" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-2acab800-cccd-4e00-86d7-b9478ad17bdc" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea899ac0-3413-4e99-965a-fe36bb31ba14]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:25 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc Sep 07 11:05:25 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:25 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc" returned: 0 in 0.350s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:25 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc Sep 07 11:05:25 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:26 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2acab800-cccd-4e00-86d7-b9478ad17bdc" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-2acab800-cccd-4e00-86d7-b9478ad17bdc" released by "delete_volume" :: held 0.651s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['88e107ae-1dfa-45a2-9892-f63d7ed58350', '5021beb1-39af-446b-ab3f-6288cb553b4f', 'bf7ff17f-90b7-4820-813e-c9e4ef98cf62', '6d547a5a-ac54-48da-8655-94786618c7da'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:26 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:05:26 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:26 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:05:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Deleted volume successfully. Sep 07 11:05:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd4fd084-67d6-446f-b631-872d4505faa1 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-2acab800-cccd-4e00-86d7-b9478ad17bdc-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (1fef8453-23d1-4a78-8da2-f68b9c482118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95f89fc-f01a-4f2d-ab24-180b781a6522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95f89fc-f01a-4f2d-ab24-180b781a6522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1320152053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc381b2-67f1-44f9-987c-411497b59215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:27Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a071995e-6ab5-4bbb-b96e-da9ca94cfcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a071995e-6ab5-4bbb-b96e-da9ca94cfcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c617ed-4a54-4b9f-bab4-ae6dd8c1e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c617ed-4a54-4b9f-bab4-ae6dd8c1e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc381b2-67f1-44f9-987c-411497b59215', 'volume_name': 'volume-1fc381b2-67f1-44f9-987c-411497b59215', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a3d770-0e29-4ca6-94fe-b16f07bccecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a3d770-0e29-4ca6-94fe-b16f07bccecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b5bed6-720b-4317-bcfb-3a8be216ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:27 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume 1fc381b2-67f1-44f9-987c-411497b59215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc381b2-67f1-44f9-987c-411497b59215', 'volume_size': 1} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1320152053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc381b2-67f1-44f9-987c-411497b59215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:27Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating volume 1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:05:27 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:27 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 1073741824 Sep 07 11:05:27 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:27 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 1073741824" returned: 0 in 0.409s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:27 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 Sep 07 11:05:27 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:27 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b5bed6-720b-4317-bcfb-3a8be216ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc381b2-67f1-44f9-987c-411497b59215', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86afd4c-ff7e-406c-932d-b1d935f14d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:27 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume volume-1fc381b2-67f1-44f9-987c-411497b59215 (1fc381b2-67f1-44f9-987c-411497b59215): created successfully Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86afd4c-ff7e-406c-932d-b1d935f14d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (1fef8453-23d1-4a78-8da2-f68b9c482118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:27 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fea2a1c6-1839-490d-9481-fe8cda8f0711 tempest-VolumesSnapshotTestJSON-2109059522 None] Created volume successfully. Sep 07 11:05:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating offline snapshot d43f7f58-6c77-4ede-afb2-15011ae80215 of volume 1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:05:28 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4946c035-1ed8-4178-9c46-4e99901a1810]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:28 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 Sep 07 11:05:28 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:28 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215" returned: 0 in 0.360s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:28 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 1G Sep 07 11:05:28 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:29 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 1G" returned: 0 in 0.379s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc381b2-67f1-44f9-987c-411497b59215 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:29 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc381b2-67f1-44f9-987c-411497b59215 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 Sep 07 11:05:29 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:29 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc381b2-67f1-44f9-987c-411497b59215 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215" returned: 0 in 0.291s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:29 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 is being set with open permissions: ugo+rw Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:29 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 Sep 07 11:05:29 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:29 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215" returned: 0 in 0.239s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:29 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.info Sep 07 11:05:29 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:29 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.info" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:29 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.info is being set with open permissions: ugo+rw Sep 07 11:05:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:29 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.info Sep 07 11:05:29 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:30 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.info" returned: 0 in 0.239s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:30 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cd97bb75-ceda-44fa-b025-e14b225be166 tempest-VolumesSnapshotTestJSON-2109059522 None] Create snapshot completed successfully Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (300f6ad0-c6ee-47a5-8efd-a4600856948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb41329-7f9f-4106-9ba7-953956d09447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb41329-7f9f-4106-9ba7-953956d09447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1184109783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57dafb6-4371-4379-b020-eadee9ae027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb2cdc444a44e1ba41adbbeced1ac08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d43f7f58-6c77-4ede-afb2-15011ae80215,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:31Z,use_quota=True,user_id='6e0564b5163c42aebdb1908c6e9ec075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54f9258-4238-4923-82da-768beb1c99fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54f9258-4238-4923-82da-768beb1c99fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcbfacd-86f9-4ebb-b406-795132360354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcbfacd-86f9-4ebb-b406-795132360354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f57dafb6-4371-4379-b020-eadee9ae027c', 'volume_name': 'volume-f57dafb6-4371-4379-b020-eadee9ae027c', 'volume_size': 1, 'snapshot_id': 'd43f7f58-6c77-4ede-afb2-15011ae80215'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4253c8-5b8b-4b37-bef2-c54cb355bf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4253c8-5b8b-4b37-bef2-c54cb355bf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ef12c6-e300-4dea-b8d2-d12ea086a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:30 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume f57dafb6-4371-4379-b020-eadee9ae027c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f57dafb6-4371-4379-b020-eadee9ae027c', 'volume_size': 1, 'snapshot_id': 'd43f7f58-6c77-4ede-afb2-15011ae80215'} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-d43f7f58-6c77-4ede-afb2-15011ae80215-f57dafb6-4371-4379-b020-eadee9ae027c" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-d43f7f58-6c77-4ede-afb2-15011ae80215-f57dafb6-4371-4379-b020-eadee9ae027c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating volume f57dafb6-4371-4379-b020-eadee9ae027c from snapshot d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-f57dafb6-4371-4379-b020-eadee9ae027c" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-f57dafb6-4371-4379-b020-eadee9ae027c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:30 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] snapshot: d43f7f58-6c77-4ede-afb2-15011ae80215, volume: f57dafb6-4371-4379-b020-eadee9ae027c, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c6e9a4-5c36-4034-96f1-37bbca062d7c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:31 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 Sep 07 11:05:31 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:31 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215" returned: 0 in 0.346s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc381b2-67f1-44f9-987c-411497b59215(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fbe0f2-acf0-4d42-94fb-789e03be5d03]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:31 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 Sep 07 11:05:31 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:31 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215" returned: 0 in 0.358s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:05:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:31 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c Sep 07 11:05:31 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:35 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c" returned: 0 in 3.932s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215, size 1024.00 MB, duration 3.93 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:05:35 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Converted 1024.00 MB image at 260.33 MB/s Sep 07 11:05:35 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c is being set with open permissions: ugo+rw Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:35 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c Sep 07 11:05:35 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:35 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c" returned: 0 in 0.231s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-f57dafb6-4371-4379-b020-eadee9ae027c" released by "_copy_volume_from_snapshot" :: held 4.945s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-d43f7f58-6c77-4ede-afb2-15011ae80215-f57dafb6-4371-4379-b020-eadee9ae027c" released by "_create_volume_from_snapshot" :: held 5.002s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ef12c6-e300-4dea-b8d2-d12ea086a55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57dafb6-4371-4379-b020-eadee9ae027c', 'volume_size': 1, 'snapshot_id': 'd43f7f58-6c77-4ede-afb2-15011ae80215'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:35 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530dc006-ecff-4848-a6a7-3b89eb7fc73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:35 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Volume volume-f57dafb6-4371-4379-b020-eadee9ae027c (f57dafb6-4371-4379-b020-eadee9ae027c): created successfully Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530dc006-ecff-4848-a6a7-3b89eb7fc73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Flow 'volume_create_manager' (300f6ad0-c6ee-47a5-8efd-a4600856948e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-55ad0d54-8393-4b1b-b264-d50598cfb432 tempest-VolumesSnapshotTestJSON-2109059522 None] Created volume successfully. Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-f57dafb6-4371-4379-b020-eadee9ae027c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-f57dafb6-4371-4379-b020-eadee9ae027c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-f57dafb6-4371-4379-b020-eadee9ae027c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-f57dafb6-4371-4379-b020-eadee9ae027c" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03e404-35d9-442f-bcaa-70bdcaf3f5c0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:36 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c Sep 07 11:05:36 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:36 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c" returned: 0 in 0.349s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:36 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c Sep 07 11:05:36 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:37 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f57dafb6-4371-4379-b020-eadee9ae027c" returned: 0 in 0.240s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-f57dafb6-4371-4379-b020-eadee9ae027c" released by "delete_volume" :: held 0.625s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['8e082757-cfc8-4a31-bee6-5c6b762b609f', 'e8ab898a-66fd-4eeb-9c17-fbc130717492', 'f30ca55d-2c54-430e-a98a-bc2a88352ac2', '451ad378-45ca-44ef-84c7-b130fc0eb1ff'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:37 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:05:37 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:37 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:05:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Deleted volume successfully. Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0fdee57b-ffd9-4310-9c51-b4e16257fe8a tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-f57dafb6-4371-4379-b020-eadee9ae027c-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-d43f7f58-6c77-4ede-afb2-15011ae80215-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-d43f7f58-6c77-4ede-afb2-15011ae80215-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-1fc381b2-67f1-44f9-987c-411497b59215" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-1fc381b2-67f1-44f9-987c-411497b59215" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-d43f7f58-6c77-4ede-afb2-15011ae80215" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-d43f7f58-6c77-4ede-afb2-15011ae80215" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Deleting offline snapshot d43f7f58-6c77-4ede-afb2-15011ae80215 of volume 1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] snapshot_file for this snap is: volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[77148982-1f4e-4d15-9107-117a86206679]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:37 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 Sep 07 11:05:37 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:37 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215" returned: 0 in 0.358s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc381b2-67f1-44f9-987c-411497b59215(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fcf009-8088-45c8-9894-01cb7ec63e35]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:38 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 Sep 07 11:05:38 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:38 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215" returned: 0 in 0.527s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:38 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 Sep 07 11:05:38 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:38 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215" returned: 0 in 0.325s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:38 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215 Sep 07 11:05:38 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:39 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215.d43f7f58-6c77-4ede-afb2-15011ae80215" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-d43f7f58-6c77-4ede-afb2-15011ae80215" released by "_delete_snapshot" :: held 1.541s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-1fc381b2-67f1-44f9-987c-411497b59215" released by "delete_snapshot" :: held 1.562s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['e91a8110-0bad-45d4-81d6-7a54289a031f', '4fb19b2c-3cc5-4b09-99be-c6a3db899d2f', '6e132deb-856b-43e2-bede-7a1a9d1270c2', '9d80a446-098f-4b07-a930-8efe14b07cd1'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Delete snapshot completed successfully. Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a0358b64-f6f1-4df7-b2ea-f8b723836c28 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-d43f7f58-6c77-4ede-afb2-15011ae80215-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-1fc381b2-67f1-44f9-987c-411497b59215-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-1fc381b2-67f1-44f9-987c-411497b59215-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-1fc381b2-67f1-44f9-987c-411497b59215" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-1fc381b2-67f1-44f9-987c-411497b59215" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c105d78-ac92-483f-962b-983752c41ce9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:39 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 Sep 07 11:05:39 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:40 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215" returned: 0 in 0.349s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:40 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215 Sep 07 11:05:40 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:40 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1fc381b2-67f1-44f9-987c-411497b59215" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-1fc381b2-67f1-44f9-987c-411497b59215" released by "delete_volume" :: held 0.691s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['522b89e1-913b-49fb-aefc-22ce4b4b3cfa', '5051f434-bf5b-45f2-8dee-8ffc5b4cc915', '32e78b86-757d-4786-91d5-94258de82b87', '73f14fc1-8a92-4e9f-a822-551d45dd1d38'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:40 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:05:40 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:40 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.255s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:05:40 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Deleted volume successfully. Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e5de309b-6576-4fab-84b6-239568c63469 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-1fc381b2-67f1-44f9-987c-411497b59215-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "cinder-quobyte-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" acquired by "delete_volume" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1177c724-5173-41a4-8d8b-8b2461170a12]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:41 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb Sep 07 11:05:41 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:41 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" returned: 0 in 0.356s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:41 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb Sep 07 11:05:41 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:41 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-quobyte-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb" released by "delete_volume" :: held 0.647s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Created reservations ['8e2d9465-3c66-4be6-ba8e-a808eae54a18', '5598d44c-ffa2-45f0-a492-9be384c2929f', '50b0ddf2-31db-4f1e-88e2-77fa8074d00b', '639bfa11-b844-4a01-a4b0-e6b6b1de9d67'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:41 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:05:41 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:42 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.231s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:42 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:05:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Deleted volume successfully. Sep 07 11:05:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4515fd6e-ec33-4257-807b-819e1ebdcc47 tempest-VolumesSnapshotTestJSON-2109059522 None] Lock "cinder-a82ae5c1-7b63-4ac6-a13c-d3e0d5b311fb-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Flow 'volume_create_manager' (ee7ce07d-1ea4-470e-857a-089aa495f06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f18ede-2d9c-44cd-a55c-f1056895c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f18ede-2d9c-44cd-a55c-f1056895c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-122785883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245ee7d8-9f65-412d-9d32-50f898db027b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e329a67fab664df79a6b4757bd956e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:50Z,use_quota=True,user_id='40dab33d63c64668baccafc7118524b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcfe602-78e8-4bc7-948d-b068ad3e601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcfe602-78e8-4bc7-948d-b068ad3e601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d62f08a-b19b-47ae-bc11-4827c0a5209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d62f08a-b19b-47ae-bc11-4827c0a5209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245ee7d8-9f65-412d-9d32-50f898db027b', 'volume_name': 'volume-245ee7d8-9f65-412d-9d32-50f898db027b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2615d48b-929c-44d3-a355-baf06598ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2615d48b-929c-44d3-a355-baf06598ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3387396e-66b5-41f7-8ae5-2e7181b437a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:49 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Volume 245ee7d8-9f65-412d-9d32-50f898db027b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245ee7d8-9f65-412d-9d32-50f898db027b', 'volume_size': 1} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-122785883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245ee7d8-9f65-412d-9d32-50f898db027b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e329a67fab664df79a6b4757bd956e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:05:50Z,use_quota=True,user_id='40dab33d63c64668baccafc7118524b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Creating volume 245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:05:49 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:05:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:49 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b 1073741824 Sep 07 11:05:49 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:50 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b 1073741824" returned: 0 in 0.426s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:50 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b Sep 07 11:05:50 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:50 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b" returned: 0 in 0.270s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3387396e-66b5-41f7-8ae5-2e7181b437a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245ee7d8-9f65-412d-9d32-50f898db027b', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf22001-7595-4d8a-97b7-52cdf065705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:05:50 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Volume volume-245ee7d8-9f65-412d-9d32-50f898db027b (245ee7d8-9f65-412d-9d32-50f898db027b): created successfully Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf22001-7595-4d8a-97b7-52cdf065705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Flow 'volume_create_manager' (ee7ce07d-1ea4-470e-857a-089aa495f06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:05:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b72cb7d2-ca82-452e-8b44-a7039a9a6918 tempest-VolumesSnapshotListTestJSON-1562113729 None] Created volume successfully. Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Creating offline snapshot 3b30aa6d-d9c0-4261-9fc7-f6a53205b651 of volume 245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de60b7a-21f6-443b-967f-b92cf789116e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:51 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b Sep 07 11:05:51 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:51 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:51 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 1G Sep 07 11:05:51 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:51 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 1G" returned: 0 in 0.402s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:51 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 Sep 07 11:05:51 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:52 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651" returned: 0 in 0.295s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:52 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 is being set with open permissions: ugo+rw Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:52 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 Sep 07 11:05:52 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:52 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651" returned: 0 in 0.251s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:52 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.info Sep 07 11:05:52 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:52 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.info" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:52 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.info is being set with open permissions: ugo+rw Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:52 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.info Sep 07 11:05:52 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:52 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.info" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-42d4847a-01d7-443c-9939-28e9defec327 tempest-VolumesSnapshotListTestJSON-1562113729 None] Create snapshot completed successfully Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Creating offline snapshot 661833c5-b3a0-4849-bfa2-951bbd5d532a of volume 245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7484379-43ad-4322-8e40-63c22eeb26ea]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:53 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 Sep 07 11:05:53 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:53 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245ee7d8-9f65-412d-9d32-50f898db027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:53 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a 1G Sep 07 11:05:53 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:54 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a 1G" returned: 0 in 0.407s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:54 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a Sep 07 11:05:54 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:54 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a" returned: 0 in 0.291s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:54 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a is being set with open permissions: ugo+rw Sep 07 11:05:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:54 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a Sep 07 11:05:54 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:54 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.389s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:54 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-86be3fd3-6f01-4359-8f8d-d4fc471a1d52 tempest-VolumesSnapshotListTestJSON-1562113729 None] Create snapshot completed successfully Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Creating offline snapshot 4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 of volume 245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e1b412-f2f2-4d0a-9436-2c608d268403]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:55 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a Sep 07 11:05:55 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:55 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a" returned: 0 in 0.366s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245ee7d8-9f65-412d-9d32-50f898db027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:55 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 1G Sep 07 11:05:55 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:56 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 1G" returned: 0 in 0.433s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:56 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 Sep 07 11:05:56 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:56 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" returned: 0 in 0.286s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:56 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 is being set with open permissions: ugo+rw Sep 07 11:05:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:56 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 Sep 07 11:05:56 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:56 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.421s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:05:56 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-07f8b2ce-cd58-40f8-8758-ef480134a418 tempest-VolumesSnapshotListTestJSON-1562113729 None] Create snapshot completed successfully Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-4dc1ed67-1c2a-4377-a5c5-2835e2c14a02-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-4dc1ed67-1c2a-4377-a5c5-2835e2c14a02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-quobyte-4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Deleting offline snapshot 4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 of volume 245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] snapshot_file for this snap is: volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca94354c-08f0-4ad6-a245-235328917dea]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:58 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 Sep 07 11:05:58 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:58 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" returned: 0 in 0.373s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245ee7d8-9f65-412d-9d32-50f898db027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e8c1f0-ceed-4735-a0e7-dc8f427388ff]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:05:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:58 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a Sep 07 11:05:58 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:59 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a" returned: 0 in 0.349s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245ee7d8-9f65-412d-9d32-50f898db027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:59 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 Sep 07 11:05:59 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:59 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" returned: 0 in 0.394s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:05:59 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02 Sep 07 11:05:59 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:05:59 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-4dc1ed67-1c2a-4377-a5c5-2835e2c14a02" released by "_delete_snapshot" :: held 1.449s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" released by "delete_snapshot" :: held 1.473s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Created reservations ['18e763fe-4939-408a-a03f-ba5c5a40c945', '62e61bb6-e1de-4e69-acdb-15de41a68cfa', '91056803-e091-44e2-ba74-79be3a2496ff', 'ca83454a-5535-4344-ad1d-41ec189e939d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:05:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Delete snapshot completed successfully. Sep 07 11:05:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-add9a49f-eeb7-497b-9273-4362747141ad tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-4dc1ed67-1c2a-4377-a5c5-2835e2c14a02-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-661833c5-b3a0-4849-bfa2-951bbd5d532a-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-661833c5-b3a0-4849-bfa2-951bbd5d532a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-quobyte-661833c5-b3a0-4849-bfa2-951bbd5d532a" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-661833c5-b3a0-4849-bfa2-951bbd5d532a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Deleting offline snapshot 661833c5-b3a0-4849-bfa2-951bbd5d532a of volume 245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] snapshot_file for this snap is: volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1826ca0-d953-466f-b04a-75846a101e5a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:00 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a Sep 07 11:06:00 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:00 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a" returned: 0 in 0.353s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245ee7d8-9f65-412d-9d32-50f898db027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f7c1e-15ac-4757-882b-3e75f86fb663]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:06:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:01 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 Sep 07 11:06:01 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:01 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651" returned: 0 in 0.363s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245ee7d8-9f65-412d-9d32-50f898db027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:06:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:01 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a Sep 07 11:06:01 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:01 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:01 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a Sep 07 11:06:01 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:01 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.661833c5-b3a0-4849-bfa2-951bbd5d532a" returned: 0 in 0.257s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-661833c5-b3a0-4849-bfa2-951bbd5d532a" released by "_delete_snapshot" :: held 1.439s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" released by "delete_snapshot" :: held 1.465s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Created reservations ['89f2e0ea-5bac-4d56-8a76-d1f54ce85370', '0d87c623-9dee-4825-9187-65f87360b1b4', '2c25774c-bfe1-4103-86c9-4c60e233bedf', 'd1d8a8ab-0edf-47d5-8f78-3ede37e42a80'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:06:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Delete snapshot completed successfully. Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-73e5d911-8b96-42f5-b3c4-184495193ffd tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-661833c5-b3a0-4849-bfa2-951bbd5d532a-delete_snapshot" released by "delete_snapshot" :: held 1.604s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-3b30aa6d-d9c0-4261-9fc7-f6a53205b651-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-3b30aa6d-d9c0-4261-9fc7-f6a53205b651-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-quobyte-3b30aa6d-d9c0-4261-9fc7-f6a53205b651" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-3b30aa6d-d9c0-4261-9fc7-f6a53205b651" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Deleting offline snapshot 3b30aa6d-d9c0-4261-9fc7-f6a53205b651 of volume 245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] snapshot_file for this snap is: volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf4314-1946-4865-978c-f43197e1d6a5]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:06:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:02 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 Sep 07 11:06:02 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:03 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651" returned: 0 in 0.371s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245ee7d8-9f65-412d-9d32-50f898db027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0677d7b-1aaa-4efa-a6f6-b623a45d81c7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:03 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b Sep 07 11:06:03 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:03 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b" returned: 0 in 0.365s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:03 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 Sep 07 11:06:03 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:03 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651" returned: 0 in 0.339s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:03 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651 Sep 07 11:06:03 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:04 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b.3b30aa6d-d9c0-4261-9fc7-f6a53205b651" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-3b30aa6d-d9c0-4261-9fc7-f6a53205b651" released by "_delete_snapshot" :: held 1.423s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" released by "delete_snapshot" :: held 1.446s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Created reservations ['2e9d85ad-ace5-481a-ae86-f13b620737b2', '3571703b-ac4c-42c9-92fb-6ec99dc46d6e', '9f2c8572-4452-42b6-8649-fa9fb2524dc5', '8b072779-d955-4094-a537-915b34f7dc21'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:06:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Delete snapshot completed successfully. Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ac6e7752-ea63-481e-aa77-59aa4793d049 tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-3b30aa6d-d9c0-4261-9fc7-f6a53205b651-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-245ee7d8-9f65-412d-9d32-50f898db027b-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-245ee7d8-9f65-412d-9d32-50f898db027b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=97,cinder:UPDATE=106,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:06:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b47a7e-e720-48fe-9df4-2a727d819541]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:05 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b Sep 07 11:06:05 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:05 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b" returned: 0 in 0.369s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:05 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b Sep 07 11:06:05 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:05 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-245ee7d8-9f65-412d-9d32-50f898db027b" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-quobyte-245ee7d8-9f65-412d-9d32-50f898db027b" released by "delete_volume" :: held 0.703s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=95,cinder:SELECT=99,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Created reservations ['1f7e4978-d870-4370-ad9a-870ed4286ab6', '7820d014-343e-4066-9dbe-5e47f0b26da3', 'd70c1087-1cd9-40cd-8aeb-8f5ff4ea10c4', '350ccc05-29b4-437c-b9d7-8f9dfc3cacca'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:06:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:05 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:06:05 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:06 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.260s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:06 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:06:06 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Deleted volume successfully. Sep 07 11:06:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-fdea338c-14f6-40e5-9ab1-5812fb67ddec tempest-VolumesSnapshotListTestJSON-1562113729 None] Lock "cinder-245ee7d8-9f65-412d-9d32-50f898db027b-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:10 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:06:10 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:10 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.257s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:06:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:06:15 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:06:16 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Flow 'volume_create_manager' (663203a9-680c-4f0f-a828-d805dc2f19f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d0f4df-9c5b-4f87-89c7-5c68a6c878f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d0f4df-9c5b-4f87-89c7-5c68a6c878f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-802163211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853a002a-52a5-4293-8a26-2d2ab529fcd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa402952e044a26b5a582ba5eecabb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:06:58Z,use_quota=True,user_id='6ce92781910947f698d9e3dd2209e25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658f4377-05cb-4dec-b86e-f06a8d4a070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658f4377-05cb-4dec-b86e-f06a8d4a070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd42a7b-83e8-4b10-8d74-5bd78bef0728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd42a7b-83e8-4b10-8d74-5bd78bef0728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853a002a-52a5-4293-8a26-2d2ab529fcd5', 'volume_name': 'volume-853a002a-52a5-4293-8a26-2d2ab529fcd5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9193cbb6-6698-4192-a3b1-d32853c8053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9193cbb6-6698-4192-a3b1-d32853c8053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c964b0d-d393-4fde-a423-c64c1cf0c347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:06:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Volume 853a002a-52a5-4293-8a26-2d2ab529fcd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853a002a-52a5-4293-8a26-2d2ab529fcd5', 'volume_size': 1} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-802163211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853a002a-52a5-4293-8a26-2d2ab529fcd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa402952e044a26b5a582ba5eecabb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:06:58Z,use_quota=True,user_id='6ce92781910947f698d9e3dd2209e25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Creating volume 853a002a-52a5-4293-8a26-2d2ab529fcd5 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:06:57 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:06:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:57 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 1073741824 Sep 07 11:06:57 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:58 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 1073741824" returned: 0 in 0.396s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:06:58 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 Sep 07 11:06:58 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:06:58 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5" returned: 0 in 0.236s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c964b0d-d393-4fde-a423-c64c1cf0c347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853a002a-52a5-4293-8a26-2d2ab529fcd5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0f5eda-6ad5-49ec-80f4-7097b8aab271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:06:58 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Volume volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 (853a002a-52a5-4293-8a26-2d2ab529fcd5): created successfully Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0f5eda-6ad5-49ec-80f4-7097b8aab271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:06:58 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Flow 'volume_create_manager' (663203a9-680c-4f0f-a828-d805dc2f19f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:06:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-15a416f2-bf0c-4b1c-95ea-5e134375558a tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Created volume successfully. Sep 07 11:06:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-cddd5f69-4904-42f4-9051-562077c7372d req-6bd2a9e8-991d-43c9-be3e-76093bc73fbc tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:06:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-cddd5f69-4904-42f4-9051-562077c7372d req-6bd2a9e8-991d-43c9-be3e-76093bc73fbc tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:06:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-cddd5f69-4904-42f4-9051-562077c7372d req-6bd2a9e8-991d-43c9-be3e-76093bc73fbc tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:06:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-cddd5f69-4904-42f4-9051-562077c7372d req-6bd2a9e8-991d-43c9-be3e-76093bc73fbc tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-853a002a-52a5-4293-8a26-2d2ab529fcd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08c8468b-9ad6-41af-9e56-e118cc47ca6a', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 11:06:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-cddd5f69-4904-42f4-9051-562077c7372d req-6bd2a9e8-991d-43c9-be3e-76093bc73fbc tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] attachment_update completed successfully. Sep 07 11:07:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-3a70bd18-40af-428e-ad34-f19ef69f84c0 req-f8cabae1-2e49-466a-a008-cf6f1b6d4ef3 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Terminate volume connection completed successfully. Sep 07 11:07:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-3a70bd18-40af-428e-ad34-f19ef69f84c0 req-f8cabae1-2e49-466a-a008-cf6f1b6d4ef3 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Deleting attachment 08c8468b-9ad6-41af-9e56-e118cc47ca6a. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Acquiring lock "cinder-853a002a-52a5-4293-8a26-2d2ab529fcd5-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "cinder-853a002a-52a5-4293-8a26-2d2ab529fcd5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Acquiring lock "cinder-quobyte-853a002a-52a5-4293-8a26-2d2ab529fcd5" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "cinder-quobyte-853a002a-52a5-4293-8a26-2d2ab529fcd5" acquired by "delete_volume" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ffaf9d-01ea-4b86-9aca-b5013144f36c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:07:02 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 Sep 07 11:07:02 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:07:02 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5" returned: 0 in 0.350s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:07:02 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5 Sep 07 11:07:02 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:07:02 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-853a002a-52a5-4293-8a26-2d2ab529fcd5" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "cinder-quobyte-853a002a-52a5-4293-8a26-2d2ab529fcd5" released by "delete_volume" :: held 0.636s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Created reservations ['28762b03-3294-4506-8c04-b4eda44ad2db', '0fdd0b26-e352-4ff9-bee8-55be427fea81', '591f1ea6-2d61-4ed8-8cbe-a5e61727619b', '00a9ef77-4be6-4324-bf84-ddbc0ff6561d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:07:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:07:02 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:07:02 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:07:03 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 07 11:07:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.235s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:07:03 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:07:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Deleted volume successfully. Sep 07 11:07:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-223b03e3-9a41-422c-968c-759413847987 tempest-TestServerVolumeAttachScenarioOldVersion-1036959436 None] Lock "cinder-853a002a-52a5-4293-8a26-2d2ab529fcd5-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:07:10 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:07:10 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:07:10 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.251s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:07:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:07:12 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:07:13 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Flow 'volume_create_manager' (b0765534-e8bc-4d37-89bb-de3a71a03d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3735ec81-559d-48a2-a5ce-540bfe24cf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3735ec81-559d-48a2-a5ce-540bfe24cf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1801083310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166f7aa-b1b4-42b6-ace9-52d2023205e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b347e8bb2a404ebeb2311ccdf5a931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:07:37Z,use_quota=True,user_id='77919239cd4a46c682463323ddf2e609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e919922-5c5f-4cd7-be2d-a3335f09a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e919922-5c5f-4cd7-be2d-a3335f09a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584ff4ce-e8f0-46c0-bd45-200e111a3ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584ff4ce-e8f0-46c0-bd45-200e111a3ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f166f7aa-b1b4-42b6-ace9-52d2023205e2', 'volume_name': 'volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be29d63-40b6-4b83-a0fa-5d9e380b8cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be29d63-40b6-4b83-a0fa-5d9e380b8cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7c10c7-c5a3-4734-80dc-434550e42f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:07:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Volume f166f7aa-b1b4-42b6-ace9-52d2023205e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2', 'volume_size': 1} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1801083310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166f7aa-b1b4-42b6-ace9-52d2023205e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b347e8bb2a404ebeb2311ccdf5a931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:07:37Z,use_quota=True,user_id='77919239cd4a46c682463323ddf2e609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Creating volume f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:07:37 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:07:37 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 1073741824 Sep 07 11:07:37 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:07:37 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 1073741824" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:07:37 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 Sep 07 11:07:37 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:07:37 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7c10c7-c5a3-4734-80dc-434550e42f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd47ce0-6bf4-4688-be21-76021bb2e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:07:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Volume volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 (f166f7aa-b1b4-42b6-ace9-52d2023205e2): created successfully Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd47ce0-6bf4-4688-be21-76021bb2e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:07:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Flow 'volume_create_manager' (b0765534-e8bc-4d37-89bb-de3a71a03d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:07:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b6391542-5bbd-4359-ac15-e1b2300924a2 tempest-TestStampPattern-402065010 None] Created volume successfully. Sep 07 11:07:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:07:47 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:08:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7b5654d-20fc-46f0-b1fb-9083ed496579 req-1847f5b3-d23e-42e2-b62e-dea51d5a2c85 tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:08:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7b5654d-20fc-46f0-b1fb-9083ed496579 req-1847f5b3-d23e-42e2-b62e-dea51d5a2c85 tempest-TestStampPattern-402065010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:08:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-f7b5654d-20fc-46f0-b1fb-9083ed496579 req-1847f5b3-d23e-42e2-b62e-dea51d5a2c85 tempest-TestStampPattern-402065010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:08:07 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-f7b5654d-20fc-46f0-b1fb-9083ed496579 req-1847f5b3-d23e-42e2-b62e-dea51d5a2c85 tempest-TestStampPattern-402065010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '770406ec-ba93-4dba-a1f0-ee5247c10759', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 11:08:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-f7b5654d-20fc-46f0-b1fb-9083ed496579 req-1847f5b3-d23e-42e2-b62e-dea51d5a2c85 tempest-TestStampPattern-402065010 None] attachment_update completed successfully. Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:10 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:08:10 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:10 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.271s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:08:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:08:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-79252fa2-858e-45c4-afdd-5564812c7cfa req-837a9a53-22ca-4b13-afb7-1a7c4f37a6c5 tempest-TestStampPattern-402065010 None] Terminate volume connection completed successfully. Sep 07 11:08:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-79252fa2-858e-45c4-afdd-5564812c7cfa req-837a9a53-22ca-4b13-afb7-1a7c4f37a6c5 tempest-TestStampPattern-402065010 None] Deleting attachment 770406ec-ba93-4dba-a1f0-ee5247c10759. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Creating offline snapshot a35f186a-403f-43b7-bce5-0520f5b2160c of volume f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[19726f1a-0faf-4852-9688-2a45203f91ea]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:12 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 Sep 07 11:08:12 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:12 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2" returned: 0 in 0.369s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:12 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c 1G Sep 07 11:08:12 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:12 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c 1G" returned: 0 in 0.394s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:12 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c Sep 07 11:08:12 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:13 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:13 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c is being set with open permissions: ugo+rw Sep 07 11:08:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:13 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c Sep 07 11:08:13 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:13 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c" returned: 0 in 0.241s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:13 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.info Sep 07 11:08:13 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:13 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.info" returned: 0 in 0.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:13 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.info is being set with open permissions: ugo+rw Sep 07 11:08:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:13 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.info Sep 07 11:08:13 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:14 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.info" returned: 0 in 0.236s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:08:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-edeb4f3e-bac0-43d8-a1f6-3d2a940c4e83 tempest-TestStampPattern-402065010 None] Create snapshot completed successfully Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Flow 'volume_create_manager' (6b485619-8df2-480c-b351-09812ded13b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae08552c-3e73-45de-9482-12c00524513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae08552c-3e73-45de-9482-12c00524513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1369852515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b449728-ec66-458f-a559-361ba1b9978f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b347e8bb2a404ebeb2311ccdf5a931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a35f186a-403f-43b7-bce5-0520f5b2160c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:08:21Z,use_quota=True,user_id='77919239cd4a46c682463323ddf2e609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9e95d2-d06a-4adf-99fa-09e1de39691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9e95d2-d06a-4adf-99fa-09e1de39691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a193cc-5233-455b-a843-3ee5c3c0c018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a193cc-5233-455b-a843-3ee5c3c0c018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b449728-ec66-458f-a559-361ba1b9978f', 'volume_name': 'volume-7b449728-ec66-458f-a559-361ba1b9978f', 'volume_size': 1, 'snapshot_id': 'a35f186a-403f-43b7-bce5-0520f5b2160c'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb95a63-fb8a-4fc4-a133-3e608223d3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb95a63-fb8a-4fc4-a133-3e608223d3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa82392-36c1-4dfc-a5db-ba85a113ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:08:20 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Volume 7b449728-ec66-458f-a559-361ba1b9978f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b449728-ec66-458f-a559-361ba1b9978f', 'volume_size': 1, 'snapshot_id': 'a35f186a-403f-43b7-bce5-0520f5b2160c'} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-quobyte-a35f186a-403f-43b7-bce5-0520f5b2160c-7b449728-ec66-458f-a559-361ba1b9978f" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-a35f186a-403f-43b7-bce5-0520f5b2160c-7b449728-ec66-458f-a559-361ba1b9978f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Creating volume 7b449728-ec66-458f-a559-361ba1b9978f from snapshot a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-quobyte-7b449728-ec66-458f-a559-361ba1b9978f" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-7b449728-ec66-458f-a559-361ba1b9978f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:08:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] snapshot: a35f186a-403f-43b7-bce5-0520f5b2160c, volume: 7b449728-ec66-458f-a559-361ba1b9978f, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d46d815-0700-4208-90a0-4ea5f0790b8b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:21 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c Sep 07 11:08:21 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:21 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c" returned: 0 in 0.415s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08561b8-d759-457f-a9c5-677ffa539b79]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:21 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 Sep 07 11:08:21 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:21 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2" returned: 0 in 0.424s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:08:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:21 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f Sep 07 11:08:21 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:27 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f" returned: 0 in 5.771s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:27 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:08:27 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Converted 1024.00 MB image at 177.39 MB/s Sep 07 11:08:27 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f is being set with open permissions: ugo+rw Sep 07 11:08:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:08:27 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f Sep 07 11:08:27 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:08:27 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 07 11:08:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f" returned: 0 in 0.263s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:08:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-7b449728-ec66-458f-a559-361ba1b9978f" released by "_copy_volume_from_snapshot" :: held 6.959s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:08:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-a35f186a-403f-43b7-bce5-0520f5b2160c-7b449728-ec66-458f-a559-361ba1b9978f" released by "_create_volume_from_snapshot" :: held 7.020s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:08:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.035s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:08:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa82392-36c1-4dfc-a5db-ba85a113ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b449728-ec66-458f-a559-361ba1b9978f', 'volume_size': 1, 'snapshot_id': 'a35f186a-403f-43b7-bce5-0520f5b2160c'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:08:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01f1436-e50d-4a22-bf3c-b03b46f6c25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:08:28 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Volume volume-7b449728-ec66-458f-a559-361ba1b9978f (7b449728-ec66-458f-a559-361ba1b9978f): created successfully Sep 07 11:08:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01f1436-e50d-4a22-bf3c-b03b46f6c25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:08:28 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Flow 'volume_create_manager' (6b485619-8df2-480c-b351-09812ded13b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:08:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9eb449fd-c20a-4aa8-9c70-64448e11642f tempest-TestStampPattern-402065010 None] Created volume successfully. Sep 07 11:08:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:08:38 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:10 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:10 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-d0ef9c95-c0f2-4b5e-bc86-a1d896652cfd req-145ff418-6d30-45ea-8fff-b310397f2d66 tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-d0ef9c95-c0f2-4b5e-bc86-a1d896652cfd req-145ff418-6d30-45ea-8fff-b310397f2d66 tempest-TestStampPattern-402065010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [req-d0ef9c95-c0f2-4b5e-bc86-a1d896652cfd req-145ff418-6d30-45ea-8fff-b310397f2d66 tempest-TestStampPattern-402065010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-d0ef9c95-c0f2-4b5e-bc86-a1d896652cfd req-145ff418-6d30-45ea-8fff-b310397f2d66 tempest-TestStampPattern-402065010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e', 'name': 'volume-7b449728-ec66-458f-a559-361ba1b9978f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b1451ac-da96-4f85-9f9a-2803dd81ac7f', 'enforce_multipath': True} {{(pid=87271) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 11:09:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-d0ef9c95-c0f2-4b5e-bc86-a1d896652cfd req-145ff418-6d30-45ea-8fff-b310397f2d66 tempest-TestStampPattern-402065010 None] attachment_update completed successfully. Sep 07 11:09:10 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.325s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:09:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:09:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [req-133102ee-b338-41d6-ab92-2cdee4bcbf56 req-e46a5898-e7db-49b0-a08e-2d5b466dfa96 tempest-TestStampPattern-402065010 None] Terminate volume connection completed successfully. Sep 07 11:09:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [req-133102ee-b338-41d6-ab92-2cdee4bcbf56 req-e46a5898-e7db-49b0-a08e-2d5b466dfa96 tempest-TestStampPattern-402065010 None] Deleting attachment 3b1451ac-da96-4f85-9f9a-2803dd81ac7f. {{(pid=87271) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-7b449728-ec66-458f-a559-361ba1b9978f-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Lock "cinder-7b449728-ec66-458f-a559-361ba1b9978f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-quobyte-7b449728-ec66-458f-a559-361ba1b9978f" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-7b449728-ec66-458f-a559-361ba1b9978f" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[793dacae-057c-4d86-9725-43c12238ec34]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:17 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f Sep 07 11:09:17 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:17 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f" returned: 0 in 0.358s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:17 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f Sep 07 11:09:17 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:18 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7b449728-ec66-458f-a559-361ba1b9978f" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-7b449728-ec66-458f-a559-361ba1b9978f" released by "delete_volume" :: held 0.636s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Created reservations ['6c84e27d-699d-417f-b4a8-86b358d55c0f', 'b411046d-79fb-41ea-beda-94d4288de469', 'fd5a7421-74b8-4d83-a967-dea2a83959f3', 'e990f9f5-7c75-4d41-bffb-d397a5e868d7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:18 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:18 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:18 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Deleted volume successfully. Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd3c240c-556f-449f-8212-6537a1d3f45c tempest-TestStampPattern-402065010 None] Lock "cinder-7b449728-ec66-458f-a559-361ba1b9978f-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-a35f186a-403f-43b7-bce5-0520f5b2160c-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Lock "cinder-a35f186a-403f-43b7-bce5-0520f5b2160c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-quobyte-f166f7aa-b1b4-42b6-ace9-52d2023205e2" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-f166f7aa-b1b4-42b6-ace9-52d2023205e2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-quobyte-a35f186a-403f-43b7-bce5-0520f5b2160c" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-a35f186a-403f-43b7-bce5-0520f5b2160c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Deleting offline snapshot a35f186a-403f-43b7-bce5-0520f5b2160c of volume f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] snapshot_file for this snap is: volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f481e61-110a-4453-8aa0-ba637275845d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:18 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c Sep 07 11:09:18 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:19 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c" returned: 0 in 0.352s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:09:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[47475037-26c6-42f6-92c5-c11182009e56]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:19 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 Sep 07 11:09:19 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:19 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2" returned: 0 in 0.522s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:19 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c Sep 07 11:09:19 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:20 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:20 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c Sep 07 11:09:20 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:20 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2.a35f186a-403f-43b7-bce5-0520f5b2160c" returned: 0 in 0.238s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-a35f186a-403f-43b7-bce5-0520f5b2160c" released by "_delete_snapshot" :: held 1.525s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-f166f7aa-b1b4-42b6-ace9-52d2023205e2" released by "delete_snapshot" :: held 1.546s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:20 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Created reservations ['ed9fde4a-72a7-40e6-b84f-37361d0e2baa', '97f045f9-b21a-4aae-ac2a-9c83232ab61c', '7b0440f4-49dd-4d8a-b890-edb788b5aa9a', '647e1390-a8b3-4e1c-b8f0-af14db0c476a'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Delete snapshot completed successfully. Sep 07 11:09:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33ee4a0b-d3ae-45b9-87ae-194f1e98fc3f tempest-TestStampPattern-402065010 None] Lock "cinder-a35f186a-403f-43b7-bce5-0520f5b2160c-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-f166f7aa-b1b4-42b6-ace9-52d2023205e2-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Lock "cinder-f166f7aa-b1b4-42b6-ace9-52d2023205e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Acquiring lock "cinder-quobyte-f166f7aa-b1b4-42b6-ace9-52d2023205e2" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-f166f7aa-b1b4-42b6-ace9-52d2023205e2" acquired by "delete_volume" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dc5446-093a-4a1d-81cd-5fe1dbedddce]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:24 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 Sep 07 11:09:24 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:24 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2" returned: 0 in 0.380s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:24 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2 Sep 07 11:09:24 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:24 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f166f7aa-b1b4-42b6-ace9-52d2023205e2" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Lock "cinder-quobyte-f166f7aa-b1b4-42b6-ace9-52d2023205e2" released by "delete_volume" :: held 0.672s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Created reservations ['43f9d159-dbe8-4345-8c31-8eb82b84a321', '365bb647-15cd-4f89-9c19-6ce9123bf079', '6304ff58-845a-4907-a7ed-f84e01e535a3', '4035b495-d10a-46e1-9e04-03b8efd33e5d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:25 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:25 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:25 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.242s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Deleted volume successfully. Sep 07 11:09:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0b6dd4dc-6075-44ee-ba31-f94ca7c9945e tempest-TestStampPattern-402065010 None] Lock "cinder-f166f7aa-b1b4-42b6-ace9-52d2023205e2-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:35 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (7ba76a56-8c7b-4276-9a1a-20bf5999972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5614e786-9763-4eee-8b16-f0721a3ac43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5614e786-9763-4eee-8b16-f0721a3ac43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624234535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:37Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13445d0b-9b4e-4857-9779-6bc64c81a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13445d0b-9b4e-4857-9779-6bc64c81a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39037a6e-95d1-4d2d-b08a-a05ea519f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39037a6e-95d1-4d2d-b08a-a05ea519f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51', 'volume_name': 'volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c7f902-41dc-4fb3-8e6b-d2f5ac56f82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c7f902-41dc-4fb3-8e6b-d2f5ac56f82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316fd02b-991a-4da7-a032-7c98fc384020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:36 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Volume 59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51', 'volume_size': 1} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624234535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:37Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Creating volume 59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:09:36 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:09:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:36 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 1073741824 Sep 07 11:09:36 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (c058ea3e-9972-4769-a33b-214c74fe7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f652d9b-7e5c-411f-9a9b-251af494ce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f652d9b-7e5c-411f-9a9b-251af494ce90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569572397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17df779-b92a-4ba5-a9ed-659b0a62054f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:37Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e0a6a1-27b8-47a9-9cd2-b497f3eb939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e0a6a1-27b8-47a9-9cd2-b497f3eb939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec1f06f-b4c7-4044-959d-467e43100102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec1f06f-b4c7-4044-959d-467e43100102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17df779-b92a-4ba5-a9ed-659b0a62054f', 'volume_name': 'volume-e17df779-b92a-4ba5-a9ed-659b0a62054f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f890665-a388-41ca-9731-ed06cf9f9427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f890665-a388-41ca-9731-ed06cf9f9427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce74f52-1af8-4698-a43f-52e88e3334cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Volume e17df779-b92a-4ba5-a9ed-659b0a62054f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17df779-b92a-4ba5-a9ed-659b0a62054f', 'volume_size': 1} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:37 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 1073741824" returned: 0 in 0.529s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:37 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 Sep 07 11:09:37 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (82a902e2-8d1a-4e17-92f1-058c872c2126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabf79f0-14a7-4b63-9f57-2727c546db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabf79f0-14a7-4b63-9f57-2727c546db9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-785309669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fe3d65-2eac-435e-a79b-b807e0653a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:37Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c04f2e4-d450-447d-9a14-4aca769422a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c04f2e4-d450-447d-9a14-4aca769422a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5ba9ed-f251-4f97-b216-498957565212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5ba9ed-f251-4f97-b216-498957565212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fe3d65-2eac-435e-a79b-b807e0653a7d', 'volume_name': 'volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ccc816-1f85-409c-953b-57ab36b3a92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ccc816-1f85-409c-953b-57ab36b3a92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914ac8a1-fceb-40c2-ab46-d5eb26f8ce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Volume f9fe3d65-2eac-435e-a79b-b807e0653a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d', 'volume_size': 1} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:37 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51" returned: 0 in 0.325s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569572397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17df779-b92a-4ba5-a9ed-659b0a62054f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:37Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Creating volume e17df779-b92a-4ba5-a9ed-659b0a62054f {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:09:37 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:37 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f 1073741824 Sep 07 11:09:37 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316fd02b-991a-4da7-a032-7c98fc384020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14e77c7-bbf5-4996-a3a3-cb1ab02a0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Volume volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 (59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51): created successfully Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14e77c7-bbf5-4996-a3a3-cb1ab02a0b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (7ba76a56-8c7b-4276-9a1a-20bf5999972f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8b1dd8c1-0ed7-447b-8e78-6eb15a0f03cb tempest-CreateVolumesFromImageTest-1338243663 None] Created volume successfully. Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (5ab8d64c-cfd8-4890-92a4-eff17c43cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f037b99-a4dc-4f5a-9135-aff5073a57ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f037b99-a4dc-4f5a-9135-aff5073a57ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1722537410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8b1523-ac5b-490d-b0e2-0648903131de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:38Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf10af-61e7-48db-a845-a3d7e342810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf10af-61e7-48db-a845-a3d7e342810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c488a47b-8c49-47f7-96e4-1be6483c4827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c488a47b-8c49-47f7-96e4-1be6483c4827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8b1523-ac5b-490d-b0e2-0648903131de', 'volume_name': 'volume-4c8b1523-ac5b-490d-b0e2-0648903131de', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a843ec8-f959-41bb-988d-e75093d3aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a843ec8-f959-41bb-988d-e75093d3aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924db144-650a-44e5-ac2f-c4a20cf68004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:37 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Volume 4c8b1523-ac5b-490d-b0e2-0648903131de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8b1523-ac5b-490d-b0e2-0648903131de', 'volume_size': 1} Sep 07 11:09:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:38 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f 1073741824" returned: 0 in 0.534s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:38 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f Sep 07 11:09:38 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (633f80e0-131c-4e70-8e31-473e859c3ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41925174-f702-4cc0-ba5e-a2c21d2e7441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41925174-f702-4cc0-ba5e-a2c21d2e7441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018795231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ef567-a784-472c-8f84-0ecdbea5eeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:38Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2521b0-142e-477c-ba14-8581506e7e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2521b0-142e-477c-ba14-8581506e7e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d271fa26-eeab-4c1c-8a64-2e689ff48eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d271fa26-eeab-4c1c-8a64-2e689ff48eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4ef567-a784-472c-8f84-0ecdbea5eeb8', 'volume_name': 'volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae0a96b-465e-44dd-9df5-bb4e8461b756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae0a96b-465e-44dd-9df5-bb4e8461b756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d6e4d1-074e-41b7-bf5a-667acce6b5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Volume 1f4ef567-a784-472c-8f84-0ecdbea5eeb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8', 'volume_size': 1} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:38 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f" returned: 0 in 0.263s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-785309669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fe3d65-2eac-435e-a79b-b807e0653a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:37Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Creating volume f9fe3d65-2eac-435e-a79b-b807e0653a7d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:09:38 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce74f52-1af8-4698-a43f-52e88e3334cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17df779-b92a-4ba5-a9ed-659b0a62054f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d0a583-2f79-4b2c-8bc7-47ad21214472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:38 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d 1073741824 Sep 07 11:09:38 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Volume volume-e17df779-b92a-4ba5-a9ed-659b0a62054f (e17df779-b92a-4ba5-a9ed-659b0a62054f): created successfully Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d0a583-2f79-4b2c-8bc7-47ad21214472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (c058ea3e-9972-4769-a33b-214c74fe7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ccebe1c4-f748-4957-8cc1-5ea3d9a3fd0f tempest-CreateVolumesFromImageTest-1338243663 None] Created volume successfully. Sep 07 11:09:38 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d 1073741824" returned: 0 in 0.404s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:38 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d Sep 07 11:09:38 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:39 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d" returned: 0 in 0.250s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1722537410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8b1523-ac5b-490d-b0e2-0648903131de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:38Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Creating volume 4c8b1523-ac5b-490d-b0e2-0648903131de {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:09:39 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914ac8a1-fceb-40c2-ab46-d5eb26f8ce52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:39 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de 1073741824 Sep 07 11:09:39 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c447387-f14b-4484-8f12-a3cf9547d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:39 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Volume volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d (f9fe3d65-2eac-435e-a79b-b807e0653a7d): created successfully Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c447387-f14b-4484-8f12-a3cf9547d321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (82a902e2-8d1a-4e17-92f1-058c872c2126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-66cc4c75-06bc-47f1-a4e1-01265f656a3b tempest-CreateVolumesFromImageTest-1338243663 None] Created volume successfully. Sep 07 11:09:39 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de 1073741824" returned: 0 in 0.408s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:39 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de Sep 07 11:09:39 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:39 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018795231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ef567-a784-472c-8f84-0ecdbea5eeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='503273edd0a24e93abdd6dd84a200393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:38Z,use_quota=True,user_id='8e22026de9614be29d56f6666840d1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Creating volume 1f4ef567-a784-472c-8f84-0ecdbea5eeb8 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:09:39 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924db144-650a-44e5-ac2f-c4a20cf68004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8b1523-ac5b-490d-b0e2-0648903131de', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:39 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 1073741824 Sep 07 11:09:39 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403adb45-0db5-4c7c-9e40-8fdc89b61f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:39 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Volume volume-4c8b1523-ac5b-490d-b0e2-0648903131de (4c8b1523-ac5b-490d-b0e2-0648903131de): created successfully Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403adb45-0db5-4c7c-9e40-8fdc89b61f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (5ab8d64c-cfd8-4890-92a4-eff17c43cae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8bc81315-7f6a-42d1-ae62-88ea7dcd3497 tempest-CreateVolumesFromImageTest-1338243663 None] Created volume successfully. Sep 07 11:09:40 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 1073741824" returned: 0 in 0.409s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:40 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 Sep 07 11:09:40 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:40 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8" returned: 0 in 0.259s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d6e4d1-074e-41b7-bf5a-667acce6b5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cc7a80-6f9a-4bdf-a9e9-ba17e7b437ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:40 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Volume volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 (1f4ef567-a784-472c-8f84-0ecdbea5eeb8): created successfully Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cc7a80-6f9a-4bdf-a9e9-ba17e7b437ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:40 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Flow 'volume_create_manager' (633f80e0-131c-4e70-8e31-473e859c3ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:40 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2342b873-3ab3-41f7-bec2-3f88928fa8e5 tempest-CreateVolumesFromImageTest-1338243663 None] Created volume successfully. Sep 07 11:09:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-1f4ef567-a784-472c-8f84-0ecdbea5eeb8-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-1f4ef567-a784-472c-8f84-0ecdbea5eeb8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-quobyte-1f4ef567-a784-472c-8f84-0ecdbea5eeb8" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-1f4ef567-a784-472c-8f84-0ecdbea5eeb8" acquired by "delete_volume" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:41 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c3aa3-3f6b-41b6-bbb4-090617cc99db]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:41 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 Sep 07 11:09:41 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:42 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8" returned: 0 in 0.348s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:42 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8 Sep 07 11:09:42 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:42 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1f4ef567-a784-472c-8f84-0ecdbea5eeb8" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-1f4ef567-a784-472c-8f84-0ecdbea5eeb8" released by "delete_volume" :: held 0.626s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Created reservations ['149f5025-51e3-458c-9170-669586a884df', 'e6370aa1-5d7a-4408-a953-5667561f27a2', '22efe6dd-a667-4a5b-98a8-446325938f3c', '5a77d047-6672-4176-b985-4c8e53e58a0c'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:42 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:42 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:42 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.256s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Deleted volume successfully. Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2152fdbb-bb2e-49d7-8483-def571040f57 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-1f4ef567-a784-472c-8f84-0ecdbea5eeb8-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-4c8b1523-ac5b-490d-b0e2-0648903131de-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-4c8b1523-ac5b-490d-b0e2-0648903131de-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-quobyte-4c8b1523-ac5b-490d-b0e2-0648903131de" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-4c8b1523-ac5b-490d-b0e2-0648903131de" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aac93e-9831-42de-aeba-2f3ee0df747a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:43 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de Sep 07 11:09:43 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:43 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de" returned: 0 in 0.344s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:43 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de Sep 07 11:09:43 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:43 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4c8b1523-ac5b-490d-b0e2-0648903131de" returned: 0 in 0.234s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-4c8b1523-ac5b-490d-b0e2-0648903131de" released by "delete_volume" :: held 0.615s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Created reservations ['291d5299-50fc-4257-824f-4de58ae9532b', 'e8076c8b-f9d3-45c0-a0ec-470d0c66b4e8', '8bccfad9-9bf2-451b-9f97-34f09d676651', '8dfdfe85-3b04-464f-833e-277314392fb1'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:43 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:43 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:43 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.235s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Deleted volume successfully. Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-98c89264-e0c2-42e2-9d9a-7a5115cd82ff tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-4c8b1523-ac5b-490d-b0e2-0648903131de-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-f9fe3d65-2eac-435e-a79b-b807e0653a7d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-f9fe3d65-2eac-435e-a79b-b807e0653a7d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-quobyte-f9fe3d65-2eac-435e-a79b-b807e0653a7d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-f9fe3d65-2eac-435e-a79b-b807e0653a7d" acquired by "delete_volume" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[357602e9-1671-4e3b-90d8-8c1d1d119574]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:44 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d Sep 07 11:09:44 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:44 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d" returned: 0 in 0.352s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:44 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d Sep 07 11:09:44 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:44 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f9fe3d65-2eac-435e-a79b-b807e0653a7d" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-f9fe3d65-2eac-435e-a79b-b807e0653a7d" released by "delete_volume" :: held 0.630s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Created reservations ['2204f6ac-bbed-4e68-8c9b-2a874523ab64', 'dfb1c0ac-df86-4e83-be4f-6271269e22d3', 'c602a746-363b-4d3a-bf98-8bdccf582fcb', 'ca5d6b99-0d18-4ba6-bb2c-7f7d2b0e6c26'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:44 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:44 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:45 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.234s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:45 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Deleted volume successfully. Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dc51730-a734-4575-8102-a7fbdbf3cd27 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-f9fe3d65-2eac-435e-a79b-b807e0653a7d-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-e17df779-b92a-4ba5-a9ed-659b0a62054f-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-e17df779-b92a-4ba5-a9ed-659b0a62054f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-quobyte-e17df779-b92a-4ba5-a9ed-659b0a62054f" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-e17df779-b92a-4ba5-a9ed-659b0a62054f" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98a74f-e348-4689-8848-5409f2391828]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:45 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f Sep 07 11:09:45 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:45 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:45 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f Sep 07 11:09:45 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:45 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e17df779-b92a-4ba5-a9ed-659b0a62054f" returned: 0 in 0.239s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-e17df779-b92a-4ba5-a9ed-659b0a62054f" released by "delete_volume" :: held 0.636s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Created reservations ['a6322f97-f1a4-41dd-a0cf-1af47d722bbf', '433a8a36-8b77-4c4f-89f8-9233bc165967', 'd74a8c10-69d7-45ef-9ee2-670efcab7561', 'a8241ebd-9b69-408e-b311-f11043459397'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:45 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:45 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:46 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Deleted volume successfully. Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-571a25ed-57e9-4f1d-9655-d82b912aa9ad tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-e17df779-b92a-4ba5-a9ed-659b0a62054f-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "cinder-quobyte-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d067f1b4-bb4c-4d70-ac67-d8ff444586ea]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:46 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 Sep 07 11:09:46 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:46 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51" returned: 0 in 0.351s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:46 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51 Sep 07 11:09:46 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:46 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51" returned: 0 in 0.241s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-quobyte-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51" released by "delete_volume" :: held 0.633s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Created reservations ['b2375b82-7d8d-416d-9792-40d627f7c7dc', '1ab1892f-4685-4441-b762-0e5cb83b0b23', '6175c4a5-3c5c-4689-860f-4296695b6b2a', '9f0e65d1-54b7-4435-851e-f39fb81d9fe7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:47 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:09:47 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:09:47 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:09:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Deleted volume successfully. Sep 07 11:09:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-02a12a12-b7bb-403a-8e88-964c37184ab4 tempest-CreateVolumesFromImageTest-1338243663 None] Lock "cinder-59f9af17-87ef-4f7f-9fd7-8e77fc1f5a51-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:09:57 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=56,cinder:SELECT=31,cinder:DELETE=3,cinder:INSERT=14 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:09:57 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=63,cinder:UPDATE=77,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (2aeaa70e-4a65-4c3a-a83f-32a82ee531c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53df16d7-a5a7-405f-b0a4-c86d42dc063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53df16d7-a5a7-405f-b0a4-c86d42dc063e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809192036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6af89c9-28bb-4ff6-a86e-24545b5947c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:59Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0f2090-cc4e-4e8c-95f6-a58839a15528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0f2090-cc4e-4e8c-95f6-a58839a15528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53450a42-d558-44e7-91e5-54632db67a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53450a42-d558-44e7-91e5-54632db67a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6af89c9-28bb-4ff6-a86e-24545b5947c5', 'volume_name': 'volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0827565a-5926-44d3-bf6b-c7acc4788190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0827565a-5926-44d3-bf6b-c7acc4788190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c058e9c-ec24-40b4-914d-48b83dc34f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:09:59 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume e6af89c9-28bb-4ff6-a86e-24545b5947c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5', 'volume_size': 1} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809192036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6af89c9-28bb-4ff6-a86e-24545b5947c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:09:59Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Creating volume e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:09:59 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:09:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:09:59 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 1073741824 Sep 07 11:09:59 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (6d4371a7-1bb9-4ee7-a17a-052ed0549fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e10e05-67fa-4e39-887f-04e584427318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (b73dce9c-13a8-49eb-a4c0-db1d09d373ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301c56ee-9366-46ae-a8cf-08a3aeac26e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e10e05-67fa-4e39-887f-04e584427318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801677804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a871350-1c30-4876-b375-58550d67beec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:00Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48214791-5253-45e3-93e9-a98ba14e5618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48214791-5253-45e3-93e9-a98ba14e5618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1da82f-ed68-463f-89e6-0a615908ebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1da82f-ed68-463f-89e6-0a615908ebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a871350-1c30-4876-b375-58550d67beec', 'volume_name': 'volume-3a871350-1c30-4876-b375-58550d67beec', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52403e27-c59b-4e9b-92f5-f621f150694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52403e27-c59b-4e9b-92f5-f621f150694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b233cb7-5dbe-47b0-a869-ea9a5e9191a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Volume 3a871350-1c30-4876-b375-58550d67beec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a871350-1c30-4876-b375-58550d67beec', 'volume_size': 1} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 1073741824" returned: 0 in 0.744s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301c56ee-9366-46ae-a8cf-08a3aeac26e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809605223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2ef616-b61e-4e95-9a10-4c90845af915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:00Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e83a20-42f2-4640-8d20-6b29ee738fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e83a20-42f2-4640-8d20-6b29ee738fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0303e1-3ff3-40b9-b473-470e765b46f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0303e1-3ff3-40b9-b473-470e765b46f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2ef616-b61e-4e95-9a10-4c90845af915', 'volume_name': 'volume-9f2ef616-b61e-4e95-9a10-4c90845af915', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b081d-e104-4d3a-8e54-2cb8443ca94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b081d-e104-4d3a-8e54-2cb8443ca94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d71c418-4065-49e3-9507-825a45453364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Volume 9f2ef616-b61e-4e95-9a10-4c90845af915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2ef616-b61e-4e95-9a10-4c90845af915', 'volume_size': 1} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:00 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 Sep 07 11:10:00 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (ede1ad17-ce51-4f85-b08e-995d3720ca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770c958a-1f42-4706-9771-d7d68beec728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770c958a-1f42-4706-9771-d7d68beec728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198013812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af23eaf2-4c13-4767-a067-c9c6112ff2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:00Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d37ce7f-2d2a-4e36-8341-314b1d2a4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d37ce7f-2d2a-4e36-8341-314b1d2a4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ebb7e6-a8c4-4de2-bbad-7619f3c151eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ebb7e6-a8c4-4de2-bbad-7619f3c151eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af23eaf2-4c13-4767-a067-c9c6112ff2ed', 'volume_name': 'volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4fea2a-3629-4b32-9619-4b071e602c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4fea2a-3629-4b32-9619-4b071e602c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa2d704-1e79-4bb8-8ff6-21c40225c8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Volume af23eaf2-4c13-4767-a067-c9c6112ff2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed', 'volume_size': 1} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:00 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5" returned: 0 in 0.418s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.507s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801677804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a871350-1c30-4876-b375-58550d67beec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:00Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Creating volume 3a871350-1c30-4876-b375-58550d67beec {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:00 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:00 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec 1073741824 Sep 07 11:10:00 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c058e9c-ec24-40b4-914d-48b83dc34f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc16d4a2-b5b9-4502-aff8-2b5dae5248e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:00 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 (e6af89c9-28bb-4ff6-a86e-24545b5947c5): created successfully Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc16d4a2-b5b9-4502-aff8-2b5dae5248e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (2aeaa70e-4a65-4c3a-a83f-32a82ee531c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-73b66f85-fd1f-4175-a6f5-b20c35ec087b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created volume successfully. Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (69e1a5c5-7179-442b-918b-3503cff1ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51389ba4-b770-42e0-81b3-92250eb526fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51389ba4-b770-42e0-81b3-92250eb526fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706972345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca52392b-f804-4c5f-a6cd-23296a34cc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:01Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f93fdb-ed5b-4c27-a03f-4fc49dfd5405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f93fdb-ed5b-4c27-a03f-4fc49dfd5405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62d0aa3-3295-4ccb-86a7-19c690d57d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62d0aa3-3295-4ccb-86a7-19c690d57d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca52392b-f804-4c5f-a6cd-23296a34cc93', 'volume_name': 'volume-ca52392b-f804-4c5f-a6cd-23296a34cc93', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cb3ab7-fd5d-495f-b8c7-92dd8e9ed36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cb3ab7-fd5d-495f-b8c7-92dd8e9ed36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653a62b1-a4ae-4bb0-b9fe-77adeb4ff370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Volume ca52392b-f804-4c5f-a6cd-23296a34cc93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca52392b-f804-4c5f-a6cd-23296a34cc93', 'volume_size': 1} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:01 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec 1073741824" returned: 0 in 0.701s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:01 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec Sep 07 11:10:01 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (f5952dd2-e408-4068-b038-b0b1465ebc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3c2a6c-1c7b-4b97-af8f-653eb2406e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3c2a6c-1c7b-4b97-af8f-653eb2406e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1688527830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871a2a90-ab8b-479d-a1a9-306a53bfbdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:02Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4480c41a-f9e2-4f0f-912b-30a1c778cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4480c41a-f9e2-4f0f-912b-30a1c778cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063ba6c7-e1f5-443c-a848-f744d76e733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063ba6c7-e1f5-443c-a848-f744d76e733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871a2a90-ab8b-479d-a1a9-306a53bfbdfe', 'volume_name': 'volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b73911-0b5f-4951-833f-c50b16de80a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b73911-0b5f-4951-833f-c50b16de80a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f06c849-5623-4a8d-ab73-36b803e1f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Volume 871a2a90-ab8b-479d-a1a9-306a53bfbdfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe', 'volume_size': 1} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:01 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec" returned: 0 in 0.357s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809605223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2ef616-b61e-4e95-9a10-4c90845af915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:00Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Creating volume 9f2ef616-b61e-4e95-9a10-4c90845af915 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:01 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b233cb7-5dbe-47b0-a869-ea9a5e9191a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a871350-1c30-4876-b375-58550d67beec', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd004406-f6e6-4c24-bc37-e253e932c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:01 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 1073741824 Sep 07 11:10:01 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Volume volume-3a871350-1c30-4876-b375-58550d67beec (3a871350-1c30-4876-b375-58550d67beec): created successfully Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd004406-f6e6-4c24-bc37-e253e932c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (6d4371a7-1bb9-4ee7-a17a-052ed0549fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0f26fff1-f68a-4350-809d-20a01ffe6978 tempest-CreateVolumesFromImageTest-1139679431 None] Created volume successfully. Sep 07 11:10:02 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 1073741824" returned: 0 in 0.466s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:02 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 Sep 07 11:10:02 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:02 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915" returned: 0 in 0.349s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198013812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af23eaf2-4c13-4767-a067-c9c6112ff2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:00Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Creating volume af23eaf2-4c13-4767-a067-c9c6112ff2ed {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:02 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d71c418-4065-49e3-9507-825a45453364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2ef616-b61e-4e95-9a10-4c90845af915', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:02 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed 1073741824 Sep 07 11:10:02 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711ef7ab-6a86-488b-b1c9-d68b7f3bb68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Volume volume-9f2ef616-b61e-4e95-9a10-4c90845af915 (9f2ef616-b61e-4e95-9a10-4c90845af915): created successfully Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711ef7ab-6a86-488b-b1c9-d68b7f3bb68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (b73dce9c-13a8-49eb-a4c0-db1d09d373ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e104682b-d863-40cb-8b41-4f413e1c2c23 tempest-CreateVolumesFromImageTest-1139679431 None] Created volume successfully. Sep 07 11:10:03 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed 1073741824" returned: 0 in 0.539s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:03 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed Sep 07 11:10:03 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:03 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed" returned: 0 in 0.288s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.458s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706972345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca52392b-f804-4c5f-a6cd-23296a34cc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:01Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Creating volume ca52392b-f804-4c5f-a6cd-23296a34cc93 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:03 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:03 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 1073741824 Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa2d704-1e79-4bb8-8ff6-21c40225c8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:03 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5537d700-540c-4f7f-a520-c81d396c6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Volume volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed (af23eaf2-4c13-4767-a067-c9c6112ff2ed): created successfully Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5537d700-540c-4f7f-a520-c81d396c6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (ede1ad17-ce51-4f85-b08e-995d3720ca5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-fed14c3d-c181-4590-907e-51ba276dfaeb tempest-CreateVolumesFromImageTest-1139679431 None] Created volume successfully. Sep 07 11:10:04 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 1073741824" returned: 0 in 0.550s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:04 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 Sep 07 11:10:04 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:04 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93" returned: 0 in 0.260s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.695s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1688527830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871a2a90-ab8b-479d-a1a9-306a53bfbdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c469de58265f4251bdc71f2b85f900e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:02Z,use_quota=True,user_id='cdbc9bb038cd46708e3574bcd736cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Creating volume 871a2a90-ab8b-479d-a1a9-306a53bfbdfe {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:04 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653a62b1-a4ae-4bb0-b9fe-77adeb4ff370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca52392b-f804-4c5f-a6cd-23296a34cc93', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fdba62-c1c7-4e09-95c5-f53ef19da84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:04 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe 1073741824 Sep 07 11:10:04 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:04 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Volume volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 (ca52392b-f804-4c5f-a6cd-23296a34cc93): created successfully Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fdba62-c1c7-4e09-95c5-f53ef19da84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (69e1a5c5-7179-442b-918b-3503cff1ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:04 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a51a7adf-695a-479b-963d-38956fdccdee tempest-CreateVolumesFromImageTest-1139679431 None] Created volume successfully. Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Flow 'volume_create_manager' (4792f956-9253-402b-9aac-b7b4b6f6250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3bc322-cfb9-42fc-b479-65d4cd42fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:04 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3bc322-cfb9-42fc-b479-65d4cd42fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662eee20-766a-4f1c-b514-efccc88a642a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c62ff31284745eb9ba77928ef7e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:05Z,use_quota=True,user_id='cd069c15591b47539eca7468a9bc7dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57f2b8fd-166f-4e94-8a82-39e164c9deb2),volume_type_id=57f2b8fd-166f-4e94-8a82-39e164c9deb2)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6aaedc-b1b5-4e7a-82fb-f1e17e0018e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6aaedc-b1b5-4e7a-82fb-f1e17e0018e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48600b1-6372-4dde-bcbe-2e14da05c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 11:10:05 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe 1073741824" returned: 0 in 0.637s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:05 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe Sep 07 11:10:05 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:05 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe" returned: 0 in 0.280s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.640s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f06c849-5623-4a8d-ab73-36b803e1f161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2eeb58c-f661-4c9d-b67c-528c9d273143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Creating offline snapshot d9daa6ff-ed77-43b4-9256-11181b81011f of volume e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:10:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Volume volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe (871a2a90-ab8b-479d-a1a9-306a53bfbdfe): created successfully Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2eeb58c-f661-4c9d-b67c-528c9d273143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Flow 'volume_create_manager' (f5952dd2-e408-4068-b038-b0b1465ebc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e2a2d-4800-4ea9-b1c6-7df31bb40f52]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e23729ec-2242-4978-84af-bd5b25ab2e51 tempest-CreateVolumesFromImageTest-1139679431 None] Created volume successfully. Sep 07 11:10:05 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 Sep 07 11:10:05 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48600b1-6372-4dde-bcbe-2e14da05c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '662eee20-766a-4f1c-b514-efccc88a642a', 'volume_name': 'volume-662eee20-766a-4f1c-b514-efccc88a642a', 'volume_size': 1, 'image_id': '83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd65458c48d88f5d47da2c6a54920c9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c62ff31284745eb9ba77928ef7e81fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3ce4a1cbbcbae2bcfd188fc2e93c3b42571aa31f9fbc245a9e8e1a2ad92e9559104cb948f50cc3fa51515927184b285caba68a49fbf66ec91d082ce6b90f82', 'id': '83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'created_at': datetime.datetime(2026, 9, 7, 9, 10, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 10, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd3f1a3-4af9-43ce-8c30-d7f8685a023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd3f1a3-4af9-43ce-8c30-d7f8685a023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79a847e-a3be-4d71-afbd-be610166b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Volume 662eee20-766a-4f1c-b514-efccc88a642a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-662eee20-766a-4f1c-b514-efccc88a642a', 'volume_size': 1, 'image_id': '83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd65458c48d88f5d47da2c6a54920c9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c62ff31284745eb9ba77928ef7e81fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3ce4a1cbbcbae2bcfd188fc2e93c3b42571aa31f9fbc245a9e8e1a2ad92e9559104cb948f50cc3fa51515927184b285caba68a49fbf66ec91d082ce6b90f82', 'id': '83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'created_at': datetime.datetime(2026, 9, 7, 9, 10, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 10, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Trying to clone 662eee20-766a-4f1c-b514-efccc88a642a from image 83e65a63-b50e-4be8-801f-d4f1cc11ea9b at location (None, [{'url': 'file:///opt/stack/data/glance/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 11:10:05 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Image download 0.00 MB at 0.00 MB/s Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9580878-ab7a-4bd4-a421-22666cc5ed9a]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:05 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5" returned: 0 in 0.447s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:06 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f 1G Sep 07 11:10:06 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:06 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD Sep 07 11:10:06 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-871a2a90-ab8b-479d-a1a9-306a53bfbdfe-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-871a2a90-ab8b-479d-a1a9-306a53bfbdfe-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-quobyte-871a2a90-ab8b-479d-a1a9-306a53bfbdfe" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-871a2a90-ab8b-479d-a1a9-306a53bfbdfe" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d55f291-29c9-4815-b05f-90d151d2ae19]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:06 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe Sep 07 11:10:06 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:06 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:06 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f 1G" returned: 0 in 0.664s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:06 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD Sep 07 11:10:06 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:06 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f Sep 07 11:10:06 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:06 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe" returned: 0 in 0.460s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:06 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe Sep 07 11:10:06 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:06 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:06 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Temporary image 83e65a63-b50e-4be8-801f-d4f1cc11ea9b is fetched for user cd069c15591b47539eca7468a9bc7dc2. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c0f69-2a51-4107-a443-25529be352c1]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:07 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f" returned: 0 in 0.410s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:07 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f is being set with open permissions: ugo+rw Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:07 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f Sep 07 11:10:07 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:07 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-871a2a90-ab8b-479d-a1a9-306a53bfbdfe" returned: 0 in 0.323s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-871a2a90-ab8b-479d-a1a9-306a53bfbdfe" released by "delete_volume" :: held 0.840s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:07 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD Sep 07 11:10:07 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Created reservations ['b6cce9de-9da0-49b8-b429-f1b8af732eb1', '4d344a06-e339-4e1e-a9d5-6e523e3371b9', '4157f085-35f8-47b8-b529-d6f766e6aecc', '6f1bc827-2411-48db-b673-d4a0d7b460fb'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:07 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:07 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:07 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f" returned: 0 in 0.342s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-ca52392b-f804-4c5f-a6cd-23296a34cc93-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:07 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-ca52392b-f804-4c5f-a6cd-23296a34cc93-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:07 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.info Sep 07 11:10:07 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-quobyte-ca52392b-f804-4c5f-a6cd-23296a34cc93" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-ca52392b-f804-4c5f-a6cd-23296a34cc93" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4bf689-90ff-434e-89ac-2f9d9e60037c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:07 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD Sep 07 11:10:07 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:07 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Deleted volume successfully. Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a389ac60-6254-4b5c-9d45-96b770c665ab tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-871a2a90-ab8b-479d-a1a9-306a53bfbdfe-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:07 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:07 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 Sep 07 11:10:07 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.info" returned: 0 in 0.364s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:07 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.info is being set with open permissions: ugo+rw Sep 07 11:10:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:07 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.info Sep 07 11:10:07 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:08 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD" returned: 1 in 0.552s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:08 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:08 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93" returned: 0 in 0.509s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.info" returned: 0 in 0.316s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:08 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93 Sep 07 11:10:08 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.199s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662eee20-766a-4f1c-b514-efccc88a642a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c62ff31284745eb9ba77928ef7e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:05Z,use_quota=True,user_id='cd069c15591b47539eca7468a9bc7dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57f2b8fd-166f-4e94-8a82-39e164c9deb2),volume_type_id=57f2b8fd-166f-4e94-8a82-39e164c9deb2)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Creating volume 662eee20-766a-4f1c-b514-efccc88a642a {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:08 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:08 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a 1073741824 Sep 07 11:10:08 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:08 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e815e972-e4d0-476b-a940-905916e52234 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Create snapshot completed successfully Sep 07 11:10:08 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ca52392b-f804-4c5f-a6cd-23296a34cc93" returned: 0 in 0.286s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-ca52392b-f804-4c5f-a6cd-23296a34cc93" released by "delete_volume" :: held 0.865s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Created reservations ['8c9beb94-32fd-45bf-a8ec-45fd6ad8f797', '553d2675-915f-4e0f-a765-1197f4f639d6', '0c0a9722-ee68-426d-a734-33e339a31933', 'd565855e-d353-4b22-9b30-69578df42ecf'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:08 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:08 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:08 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a 1073741824" returned: 0 in 0.554s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:08 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a Sep 07 11:10:08 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:08 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.284s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:08 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Deleted volume successfully. Sep 07 11:10:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a2fd3210-5121-4e74-ba08-47349b2923f7 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-ca52392b-f804-4c5f-a6cd-23296a34cc93-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:09 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a" returned: 0 in 0.285s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Attempting download of 83e65a63-b50e-4be8-801f-d4f1cc11ea9b ((None, [{'url': 'file:///opt/stack/data/glance/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'metadata': {}}])) to volume 662eee20-766a-4f1c-b514-efccc88a642a. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a24fd42-195f-48dc-83ad-81387056eb3b]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_shy79j9k {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:09 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_shy79j9k Sep 07 11:10:09 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:09 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_shy79j9k" returned: 0 in 0.385s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_shy79j9k {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (6c19f7ec-ff75-4125-b797-617110e34d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d1250f-8d16-4a8a-ae67-9c7cb53f1ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d1250f-8d16-4a8a-ae67-9c7cb53f1ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2103710411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a8b7dd-e824-470b-a99e-153fc95e3ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:10Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e197882-8da1-4a9b-8685-7de8ba00eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e197882-8da1-4a9b-8685-7de8ba00eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36739b1a-25d6-4547-a83a-82b79603845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36739b1a-25d6-4547-a83a-82b79603845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a8b7dd-e824-470b-a99e-153fc95e3ed8', 'volume_name': 'volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57559240-7f74-45d9-b847-1d3557256528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57559240-7f74-45d9-b847-1d3557256528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cf3dc-0f7e-4f2f-b8c0-6182f952ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:09 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume 70a8b7dd-e824-470b-a99e-153fc95e3ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8', 'volume_size': 1} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2103710411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a8b7dd-e824-470b-a99e-153fc95e3ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:10Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Creating volume 70a8b7dd-e824-470b-a99e-153fc95e3ed8 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:09 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-af23eaf2-4c13-4767-a067-c9c6112ff2ed-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:09 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 1073741824 Sep 07 11:10:09 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:09 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_shy79j9k Sep 07 11:10:09 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-af23eaf2-4c13-4767-a067-c9c6112ff2ed-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-quobyte-af23eaf2-4c13-4767-a067-c9c6112ff2ed" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-af23eaf2-4c13-4767-a067-c9c6112ff2ed" acquired by "delete_volume" :: waited 0.049s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4eda9b-b0ba-48a8-95b9-c9411c1e5e85]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (0a6adb27-c081-4d6c-9049-c9cf0fdba655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfba18f-dd71-4726-9143-717de7dfb37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfba18f-dd71-4726-9143-717de7dfb37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019106540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45d79b3-3763-445b-9a4e-9cc9e055e7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:10Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d38090-4ab1-4fbb-becd-e3ffc446df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d38090-4ab1-4fbb-becd-e3ffc446df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66abd7e-78e7-4fdb-9511-e65d336aaabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66abd7e-78e7-4fdb-9511-e65d336aaabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45d79b3-3763-445b-9a4e-9cc9e055e7eb', 'volume_name': 'volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1eac298-f3e1-40a6-8be9-6165b046aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1eac298-f3e1-40a6-8be9-6165b046aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9f6ec6-c637-421b-b7fb-e6339ff80bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:10 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume f45d79b3-3763-445b-9a4e-9cc9e055e7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb', 'volume_size': 1} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:10 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed Sep 07 11:10:10 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:10 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_shy79j9k" returned: 1 in 0.737s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_shy79j9k' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2951bb-075c-43b3-8db7-7c5b62da6a18]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:10 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD Sep 07 11:10:10 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:10 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed" returned: 0 in 0.532s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:10 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 1073741824" returned: 0 in 0.820s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:10 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:10 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:10 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:10 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:10 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 Sep 07 11:10:10 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:10 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:11 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (70a5df2b-a11a-4b56-9b98-e3b790364083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2776dde-8f49-4618-b43c-eecf4cb31cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af23eaf2-4c13-4767-a067-c9c6112ff2ed" returned: 0 in 0.560s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2776dde-8f49-4618-b43c-eecf4cb31cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701381358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f16bf9-b1b3-4880-be27-9864c15c2790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:11Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721f9454-7d79-473e-afab-5bf2a8f70fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721f9454-7d79-473e-afab-5bf2a8f70fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6111dc7a-b5ab-4de6-964b-68716972e9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6111dc7a-b5ab-4de6-964b-68716972e9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f16bf9-b1b3-4880-be27-9864c15c2790', 'volume_name': 'volume-42f16bf9-b1b3-4880-be27-9864c15c2790', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097ac7d8-9450-4984-9fce-d2fd90891eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD Sep 07 11:10:11 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097ac7d8-9450-4984-9fce-d2fd90891eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d612c18-3248-40db-845d-0c628a45d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume 42f16bf9-b1b3-4880-be27-9864c15c2790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f16bf9-b1b3-4880-be27-9864c15c2790', 'volume_size': 1} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.547s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-af23eaf2-4c13-4767-a067-c9c6112ff2ed" released by "delete_volume" :: held 1.240s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8" returned: 0 in 0.489s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019106540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45d79b3-3763-445b-9a4e-9cc9e055e7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:10Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Creating volume f45d79b3-3763-445b-9a4e-9cc9e055e7eb {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:11 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cf3dc-0f7e-4f2f-b8c0-6182f952ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f526c9f3-b577-496b-a963-16ae797f226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb 1073741824 Sep 07 11:10:11 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:11 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 (70a8b7dd-e824-470b-a99e-153fc95e3ed8): created successfully Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f526c9f3-b577-496b-a963-16ae797f226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (6c19f7ec-ff75-4125-b797-617110e34d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-12cf51d4-c2a8-4069-9318-8037137210ce tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created volume successfully. Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Created reservations ['373430da-17a1-403a-b562-88383cc49e99', '2ac141b9-b705-406b-a699-d4d559a2870c', '7e17e649-80f8-4842-8eb9-418ce4547793', '2a029bb8-9ac9-4213-95d4-9313c18c38b6'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:11 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:11 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:11 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD" returned: 1 in 0.733s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] 83e65a63-b50e-4be8-801f-d4f1cc11ea9b was raw, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:11 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a Sep 07 11:10:11 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (a7e59e64-e5eb-4690-9c68-fc395fb0f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0314bf-90d7-48df-a0ba-c61765c3a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0314bf-90d7-48df-a0ba-c61765c3a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583008363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e25364-ddba-415f-8858-a47f2f92cc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:12Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b1cb81-8913-41f4-a46f-38e40477bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b1cb81-8913-41f4-a46f-38e40477bc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88611077-20dc-4ad9-a4d7-c28fd36403b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88611077-20dc-4ad9-a4d7-c28fd36403b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e25364-ddba-415f-8858-a47f2f92cc04', 'volume_name': 'volume-49e25364-ddba-415f-8858-a47f2f92cc04', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc390f41-2ab9-4d2e-b4d1-3c1b2c453b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc390f41-2ab9-4d2e-b4d1-3c1b2c453b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6adc45e-beca-4998-8c20-6e8181eedc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:11 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume 49e25364-ddba-415f-8858-a47f2f92cc04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e25364-ddba-415f-8858-a47f2f92cc04', 'volume_size': 1} Sep 07 11:10:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:12 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.413s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Deleted volume successfully. Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-dd4f7919-a6d2-4cb8-834f-35414091af18 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-af23eaf2-4c13-4767-a067-c9c6112ff2ed-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:12 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb 1073741824" returned: 0 in 0.861s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:12 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb Sep 07 11:10:12 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (061d1d46-3b84-4818-92e4-5efab36b9501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86b0fe1-babd-4d56-a4c8-a618475238d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (69cecc20-c1e7-4fde-9cfd-3204110cbd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6418e07a-d2a0-4d68-ae07-5640afc6b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86b0fe1-babd-4d56-a4c8-a618475238d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28575897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6c4df0-b7df-4ec7-a5af-6d8b25514c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:12Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a33186-3e9d-4439-bd6f-7bec56d5ad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a33186-3e9d-4439-bd6f-7bec56d5ad7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dec0e9-8705-49bd-a159-f72140711578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dec0e9-8705-49bd-a159-f72140711578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a6c4df0-b7df-4ec7-a5af-6d8b25514c41', 'volume_name': 'volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d868790-7f93-47d4-bd62-8efff6929d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d868790-7f93-47d4-bd62-8efff6929d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9498ea6e-98ea-474d-93e0-c828654cf3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Volume 7a6c4df0-b7df-4ec7-a5af-6d8b25514c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41', 'volume_size': 1} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a" returned: 0 in 0.675s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83e65a63-b50e-4be8-801f-d4f1cc11ea9b_bz3kk4v6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-9f2ef616-b61e-4e95-9a10-4c90845af915-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6418e07a-d2a0-4d68-ae07-5640afc6b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108479321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db886b08-eb46-4def-965a-999cb6abe3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:12Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a1d359-95be-40f0-b3d3-1245d63c21c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a 1G Sep 07 11:10:12 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a1d359-95be-40f0-b3d3-1245d63c21c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4efe6b-8978-4243-840d-342fc6d0e79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4efe6b-8978-4243-840d-342fc6d0e79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db886b08-eb46-4def-965a-999cb6abe3b4', 'volume_name': 'volume-db886b08-eb46-4def-965a-999cb6abe3b4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee05cfa1-c6aa-427d-a579-2e8653265b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee05cfa1-c6aa-427d-a579-2e8653265b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c8f2ee-a22b-4028-9e1e-54531ee25e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume db886b08-eb46-4def-965a-999cb6abe3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db886b08-eb46-4def-965a-999cb6abe3b4', 'volume_size': 1} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-9f2ef616-b61e-4e95-9a10-4c90845af915-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-quobyte-9f2ef616-b61e-4e95-9a10-4c90845af915" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-9f2ef616-b61e-4e95-9a10-4c90845af915" acquired by "delete_volume" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:12 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb" returned: 0 in 0.339s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701381358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f16bf9-b1b3-4880-be27-9864c15c2790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:11Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Creating volume 42f16bf9-b1b3-4880-be27-9864c15c2790 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d23c99-6776-428e-9370-210a9d167ea8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:12 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 1073741824 Sep 07 11:10:12 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9f6ec6-c637-421b-b7fb-e6339ff80bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161867b6-f29a-4dc6-8a14-2163b17f1adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb (f45d79b3-3763-445b-9a4e-9cc9e055e7eb): created successfully Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161867b6-f29a-4dc6-8a14-2163b17f1adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (0a6adb27-c081-4d6c-9049-c9cf0fdba655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-521c51f2-bdc0-4ff1-a86f-44e74c407fc5 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created volume successfully. Sep 07 11:10:12 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 Sep 07 11:10:12 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:12 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a 1G" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Downloaded image 83e65a63-b50e-4be8-801f-d4f1cc11ea9b ((None, [{'url': 'file:///opt/stack/data/glance/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'metadata': {}}])) to volume 662eee20-766a-4f1c-b514-efccc88a642a successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Temporary image 83e65a63-b50e-4be8-801f-d4f1cc11ea9b for user cd069c15591b47539eca7468a9bc7dc2 is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Marking volume 662eee20-766a-4f1c-b514-efccc88a642a as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Copying metadata from image 83e65a63-b50e-4be8-801f-d4f1cc11ea9b to 662eee20-766a-4f1c-b514-efccc88a642a. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Creating volume glance metadata for volume 662eee20-766a-4f1c-b514-efccc88a642a backed by image 83e65a63-b50e-4be8-801f-d4f1cc11ea9b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cd65458c48d88f5d47da2c6a54920c9f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79a847e-a3be-4d71-afbd-be610166b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662eee20-766a-4f1c-b514-efccc88a642a', 'volume_size': 1, 'image_id': '83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd65458c48d88f5d47da2c6a54920c9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c62ff31284745eb9ba77928ef7e81fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3ce4a1cbbcbae2bcfd188fc2e93c3b42571aa31f9fbc245a9e8e1a2ad92e9559104cb948f50cc3fa51515927184b285caba68a49fbf66ec91d082ce6b90f82', 'id': '83e65a63-b50e-4be8-801f-d4f1cc11ea9b', 'created_at': datetime.datetime(2026, 9, 7, 9, 10, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 10, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83e65a63-b50e-4be8-801f-d4f1cc11ea9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbe9352-be8e-40f7-89b9-f8b93a822571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Volume volume-662eee20-766a-4f1c-b514-efccc88a642a (662eee20-766a-4f1c-b514-efccc88a642a): created successfully Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbe9352-be8e-40f7-89b9-f8b93a822571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Flow 'volume_create_manager' (4792f956-9253-402b-9aac-b7b4b6f6250b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-bccee07b-1c6e-458f-a1a5-61354dc0bc4f tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Created volume successfully. Sep 07 11:10:12 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915" returned: 0 in 0.432s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:12 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915 Sep 07 11:10:12 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:13 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 1073741824" returned: 0 in 0.522s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:13 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 Sep 07 11:10:13 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:13 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-9f2ef616-b61e-4e95-9a10-4c90845af915" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-9f2ef616-b61e-4e95-9a10-4c90845af915" released by "delete_volume" :: held 0.753s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Created reservations ['4d3e1ead-f2ea-4a28-a3dc-4e1db19194a8', '9373ef7c-c3a1-4948-957e-1c1f128052a2', 'af50244e-aa88-4845-96b0-4fec509cc058', '2c027634-8327-4867-a44c-36a51de0ae70'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:13 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790" returned: 0 in 0.266s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.489s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583008363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e25364-ddba-415f-8858-a47f2f92cc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:12Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Creating volume 49e25364-ddba-415f-8858-a47f2f92cc04 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:13 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:13 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 1073741824 Sep 07 11:10:13 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d612c18-3248-40db-845d-0c628a45d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f16bf9-b1b3-4880-be27-9864c15c2790', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5661b10-7736-428b-a2b4-a55aa069208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:13 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:13 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:13 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume volume-42f16bf9-b1b3-4880-be27-9864c15c2790 (42f16bf9-b1b3-4880-be27-9864c15c2790): created successfully Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5661b10-7736-428b-a2b4-a55aa069208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (70a5df2b-a11a-4b56-9b98-e3b790364083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4ed86501-5b00-4742-bfd4-1e10a2cd7f22 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created volume successfully. Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-3a871350-1c30-4876-b375-58550d67beec-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-3a871350-1c30-4876-b375-58550d67beec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "cinder-quobyte-3a871350-1c30-4876-b375-58550d67beec" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-3a871350-1c30-4876-b375-58550d67beec" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[185e4215-dca9-407c-b47c-84a4eae6602d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:13 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.333s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Deleted volume successfully. Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aa2ad90-4927-4d81-b6b0-69f23ae235ac tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-9f2ef616-b61e-4e95-9a10-4c90845af915-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:13 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec Sep 07 11:10:13 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:13 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 1073741824" returned: 0 in 0.524s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Acquiring lock "cinder-662eee20-766a-4f1c-b514-efccc88a642a-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:13 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 Sep 07 11:10:13 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "cinder-662eee20-766a-4f1c-b514-efccc88a642a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Acquiring lock "cinder-quobyte-662eee20-766a-4f1c-b514-efccc88a642a" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "cinder-quobyte-662eee20-766a-4f1c-b514-efccc88a642a" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[05860086-1f22-48cc-9f00-d3f6001cd139]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:14 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec" returned: 0 in 0.410s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:14 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec Sep 07 11:10:14 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:14 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a Sep 07 11:10:14 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:14 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.949s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28575897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6c4df0-b7df-4ec7-a5af-6d8b25514c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:12Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Creating volume 7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:14 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6adc45e-beca-4998-8c20-6e8181eedc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e25364-ddba-415f-8858-a47f2f92cc04', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0e34c1-d749-487a-830e-f7a0ce36f8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:14 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 1073741824 Sep 07 11:10:14 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:14 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3a871350-1c30-4876-b375-58550d67beec" returned: 0 in 0.337s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:14 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume volume-49e25364-ddba-415f-8858-a47f2f92cc04 (49e25364-ddba-415f-8858-a47f2f92cc04): created successfully Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0e34c1-d749-487a-830e-f7a0ce36f8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (a7e59e64-e5eb-4690-9c68-fc395fb0f118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-quobyte-3a871350-1c30-4876-b375-58550d67beec" released by "delete_volume" :: held 0.802s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-51e287e9-f011-46a6-b18a-63321d9b4926 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created volume successfully. Sep 07 11:10:14 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a" returned: 0 in 0.436s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Created reservations ['852f7564-f518-48ee-97b6-2831af040113', 'ff1e326f-6c85-494a-9be2-985657e50e3f', 'b15c7898-442f-4b32-be8e-8454219ca8cc', '4709473c-6e69-4ee5-ba38-afa1513c9053'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:14 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a Sep 07 11:10:14 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:14 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:14 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:14 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-662eee20-766a-4f1c-b514-efccc88a642a" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "cinder-quobyte-662eee20-766a-4f1c-b514-efccc88a642a" released by "delete_volume" :: held 0.824s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:14 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Created reservations ['5aaaa582-0a35-4aa2-ac00-50b0bca24580', '44772248-1b3a-45c9-bfc9-c8e63c921ee1', '60c944f8-a3d4-4db7-8a45-25389210cc27', '297c47bc-7d88-4474-9bad-d3e3469f271e'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 1073741824" returned: 0 in 0.612s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:14 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.327s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:15 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 Sep 07 11:10:15 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Deleted volume successfully. Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e12dd424-26bd-4d0e-811f-324c0c854c69 tempest-CreateVolumesFromImageTest-1139679431 None] Lock "cinder-3a871350-1c30-4876-b375-58550d67beec-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:15 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:15 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:15 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" returned: 0 in 0.381s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.965s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108479321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db886b08-eb46-4def-965a-999cb6abe3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26ab3b126fc4e38b243da1357cb45e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:12Z,use_quota=True,user_id='11e440985d7c44acb9bea62f7f4be511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Creating volume db886b08-eb46-4def-965a-999cb6abe3b4 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:15 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:15 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:15 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 1073741824 Sep 07 11:10:15 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9498ea6e-98ea-474d-93e0-c828654cf3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b04ddc-adab-42b8-9a92-49e9ba4eda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Deleted volume successfully. Sep 07 11:10:15 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Volume volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 (7a6c4df0-b7df-4ec7-a5af-6d8b25514c41): created successfully Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b04ddc-adab-42b8-9a92-49e9ba4eda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (061d1d46-3b84-4818-92e4-5efab36b9501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-beb00dec-3564-4a97-9766-f9b16d1ad312 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-8d144f75-de3e-47d0-85d1-ef109476bbe2 tempest-VolumeAndVolumeTypeFromImageTest-1845014582 None] Lock "cinder-662eee20-766a-4f1c-b514-efccc88a642a-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:15 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 1073741824" returned: 0 in 0.558s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:16 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 Sep 07 11:10:16 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:16 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4" returned: 0 in 0.302s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c8f2ee-a22b-4028-9e1e-54531ee25e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db886b08-eb46-4def-965a-999cb6abe3b4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d2e5a4-1c72-48be-af76-6331a32c4e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:16 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Volume volume-db886b08-eb46-4def-965a-999cb6abe3b4 (db886b08-eb46-4def-965a-999cb6abe3b4): created successfully Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d2e5a4-1c72-48be-af76-6331a32c4e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Flow 'volume_create_manager' (69cecc20-c1e7-4fde-9cfd-3204110cbd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-276b59c2-a308-4283-ba07-568cd3c50243 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created volume successfully. Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-db886b08-eb46-4def-965a-999cb6abe3b4-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-db886b08-eb46-4def-965a-999cb6abe3b4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-db886b08-eb46-4def-965a-999cb6abe3b4" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-db886b08-eb46-4def-965a-999cb6abe3b4" acquired by "delete_volume" :: waited 0.037s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[92279f03-c32b-4241-9981-b906d2e15d60]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot 4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 of volume 7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069f5d0-cd8f-47f1-9da1-347e4c608fc9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:16 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 Sep 07 11:10:16 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:17 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 Sep 07 11:10:17 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:17 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4" returned: 0 in 0.438s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:17 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4 Sep 07 11:10:17 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:17 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" returned: 0 in 0.548s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:17 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 1G Sep 07 11:10:17 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:17 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-db886b08-eb46-4def-965a-999cb6abe3b4" returned: 0 in 0.420s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-db886b08-eb46-4def-965a-999cb6abe3b4" released by "delete_volume" :: held 0.955s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created reservations ['3b3d4d34-9a9b-4f47-9ac0-5f6d4de026a1', 'd0e92109-c02f-4199-b8b7-2ec7cb1c57ba', 'ff7503fa-8fe1-44b7-b91f-59f3fe393dd1', '80628b18-1820-4fe4-a800-15ce32d4fff5'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:17 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:17 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:18 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 1G" returned: 0 in 0.603s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:18 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 Sep 07 11:10:18 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:18 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.329s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Deleted volume successfully. Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2fd83687-22bc-466a-92a3-90392bb45fac tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-db886b08-eb46-4def-965a-999cb6abe3b4-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:18 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" returned: 0 in 0.398s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:18 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 is being set with open permissions: ugo+rw Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:18 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 Sep 07 11:10:18 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (2daec8f0-1f2b-4ecf-b9e0-7b7404c9b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7429912-d7c6-463f-bd39-fc6399a212f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7429912-d7c6-463f-bd39-fc6399a212f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482190199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73105a-4c21-4845-a7e7-915e3ed702da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:18Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4619d9e-ca59-4831-8c32-f04cd5ac8283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4619d9e-ca59-4831-8c32-f04cd5ac8283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc028bfb-5fe3-479f-8879-045d9b9b5adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc028bfb-5fe3-479f-8879-045d9b9b5adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b73105a-4c21-4845-a7e7-915e3ed702da', 'volume_name': 'volume-8b73105a-4c21-4845-a7e7-915e3ed702da', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45a2ea9-e6fb-47f9-8f2a-9b6dacb29c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45a2ea9-e6fb-47f9-8f2a-9b6dacb29c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c807deda-e8c7-4115-a460-6ebd33a19d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:18 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume 8b73105a-4c21-4845-a7e7-915e3ed702da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b73105a-4c21-4845-a7e7-915e3ed702da', 'volume_size': 1} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:18 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" returned: 0 in 0.276s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:18 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.info Sep 07 11:10:18 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-49e25364-ddba-415f-8858-a47f2f92cc04-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-49e25364-ddba-415f-8858-a47f2f92cc04-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-49e25364-ddba-415f-8858-a47f2f92cc04" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-49e25364-ddba-415f-8858-a47f2f92cc04" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:19 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.info" returned: 0 in 0.292s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:19 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.info is being set with open permissions: ugo+rw Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccec8eb-60d7-4d72-ae1e-936537c54a42]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:19 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.info Sep 07 11:10:19 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:19 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 Sep 07 11:10:19 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:19 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.info" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482190199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73105a-4c21-4845-a7e7-915e3ed702da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:18Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Creating volume 8b73105a-4c21-4845-a7e7-915e3ed702da {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:19 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:19 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da 1073741824 Sep 07 11:10:19 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-112a5672-d4c1-44a5-8b64-9e8000f80cc9 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:10:19 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04" returned: 0 in 0.420s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:19 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04 Sep 07 11:10:19 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:19 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-49e25364-ddba-415f-8858-a47f2f92cc04" returned: 0 in 0.299s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-49e25364-ddba-415f-8858-a47f2f92cc04" released by "delete_volume" :: held 0.772s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:19 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da 1073741824" returned: 0 in 0.483s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created reservations ['5e990692-f205-4bd9-aa1b-eaf0dd79ff9a', 'bb80a090-2c5f-4e28-8e4b-339df661a663', 'bbac15c0-2fb8-4f5e-85e3-6db9533946f1', 'ff36f228-fc63-4acc-82b1-d4fae4a26087'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:19 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da Sep 07 11:10:19 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:20 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:20 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Lock "cinder-4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot 4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 of volume 7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:10:20 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-42f16bf9-b1b3-4880-be27-9864c15c2790-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da" returned: 0 in 0.344s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3990cc-e46e-471d-9e19-d18c8df761a1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-42f16bf9-b1b3-4880-be27-9864c15c2790-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c807deda-e8c7-4115-a460-6ebd33a19d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b73105a-4c21-4845-a7e7-915e3ed702da', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1396461a-7ed5-4697-8e4e-646ee0d7e29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:20 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.334s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Deleted volume successfully. Sep 07 11:10:20 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume volume-8b73105a-4c21-4845-a7e7-915e3ed702da (8b73105a-4c21-4845-a7e7-915e3ed702da): created successfully Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1396461a-7ed5-4697-8e4e-646ee0d7e29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (2daec8f0-1f2b-4ecf-b9e0-7b7404c9b015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:20 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 Sep 07 11:10:20 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-42f16bf9-b1b3-4880-be27-9864c15c2790" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6ad8caa4-434f-43be-b4fe-e9da9cead5e0 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created volume successfully. Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4f45bde9-d7c3-49b1-8c83-e85d175f66b3 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-49e25364-ddba-415f-8858-a47f2f92cc04-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-42f16bf9-b1b3-4880-be27-9864c15c2790" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92a543f-cb32-41a2-9728-0022fc35caf4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:20 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 Sep 07 11:10:20 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:20 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" returned: 0 in 0.486s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa4264c-1116-4bb4-b6c8-f2ca0b096862]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:20 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790" returned: 0 in 0.434s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:20 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790 Sep 07 11:10:20 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:20 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 Sep 07 11:10:20 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:21 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" returned: 0 in 0.452s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:21 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 Sep 07 11:10:21 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:21 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-42f16bf9-b1b3-4880-be27-9864c15c2790" returned: 0 in 0.447s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-42f16bf9-b1b3-4880-be27-9864c15c2790" released by "delete_volume" :: held 0.951s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (687d9f59-4a55-48fe-bffe-9b9cbed969a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932d51a2-4b5a-4469-9151-126804235c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932d51a2-4b5a-4469-9151-126804235c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416731173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:21Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3cdecf-2538-4a03-9447-5f52d07dff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3cdecf-2538-4a03-9447-5f52d07dff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa5ff22-1f00-4092-8885-7ca9f7c2bf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa5ff22-1f00-4092-8885-7ca9f7c2bf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb', 'volume_name': 'volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d726c05b-ca29-490d-af45-2ca0f673eee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d726c05b-ca29-490d-af45-2ca0f673eee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682d5946-6c5d-4f82-aa82-7f1018bac921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:21 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume 949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb', 'volume_size': 1} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416731173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:21Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Creating volume 949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:21 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:21 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb 1073741824 Sep 07 11:10:21 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created reservations ['ef083590-f86f-4a48-ac0b-f98b223d8bdd', '1689ba9c-6406-4558-b3e6-f626fc91c0f2', '55ba0293-bfda-4779-9203-0d0ac79f2647', 'bcc09521-54ce-4047-8194-7e33b87bad2d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:21 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" returned: 0 in 0.518s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:21 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:21 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:21 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434 Sep 07 11:10:21 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (d3aee179-7cb7-41e5-bc10-52586da4ecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a38caf-4ad1-43af-8f8a-6f80111bed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a38caf-4ad1-43af-8f8a-6f80111bed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598498883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d420e5-8aa8-42e8-a644-7cbf13ebdaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:22Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:21 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8fb674-856f-4e1f-b9e9-8be34409d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8fb674-856f-4e1f-b9e9-8be34409d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d7d648-cd16-4aa0-a1d1-53d9f15c9949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d7d648-cd16-4aa0-a1d1-53d9f15c9949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d420e5-8aa8-42e8-a644-7cbf13ebdaeb', 'volume_name': 'volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c06c76-2d3c-45e9-b8a6-424455a14c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c06c76-2d3c-45e9-b8a6-424455a14c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998feff2-b483-47c0-bbb6-7f19ff4ebbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume 19d420e5-8aa8-42e8-a644-7cbf13ebdaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb', 'volume_size': 1} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:22 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41.4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" returned: 0 in 0.307s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434" released by "_delete_snapshot" :: held 1.934s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:22 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" released by "delete_snapshot" :: held 1.973s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.387s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Deleted volume successfully. Sep 07 11:10:22 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb 1073741824" returned: 0 in 0.624s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-792bdae5-8a90-43c8-bcc7-2f429666bbff tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-42f16bf9-b1b3-4880-be27-9864c15c2790-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Created reservations ['8a91d824-8726-47de-ab1a-5a61fbe8b202', '13a526f9-528b-4ddd-b633-ae5d9177fd8e', 'b1c24040-996a-4f71-bef9-1a5456bf9fb5', 'aa82a73b-0d0b-450d-b200-f098c1a920b0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:22 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb Sep 07 11:10:22 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7d1b6b61-3df9-455e-874f-7ae29d186c02 tempest-ProjectMemberTests-652306273 None] Lock "cinder-4fb4e8d2-9a7f-48d8-b12f-bfc5ad7ce434-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (73e0efd7-b58f-4cd9-933e-e8e874f1b846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3866f8fd-41bf-4859-bfce-5cc368dcfe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3866f8fd-41bf-4859-bfce-5cc368dcfe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502845232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6174ad5-1701-4998-89e4-7086825e3b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:22Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea6509-fdb8-4104-8c93-67e96be6c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea6509-fdb8-4104-8c93-67e96be6c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31547961-4ddb-478f-bf3d-6b1a5a625536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31547961-4ddb-478f-bf3d-6b1a5a625536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6174ad5-1701-4998-89e4-7086825e3b62', 'volume_name': 'volume-b6174ad5-1701-4998-89e4-7086825e3b62', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee00a5cd-6d51-4399-a07e-49a5f4874c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee00a5cd-6d51-4399-a07e-49a5f4874c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2e7099-b4f5-4b54-9f70-19162a6bccaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume b6174ad5-1701-4998-89e4-7086825e3b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6174ad5-1701-4998-89e4-7086825e3b62', 'volume_size': 1} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-f45d79b3-3763-445b-9a4e-9cc9e055e7eb-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-f45d79b3-3763-445b-9a4e-9cc9e055e7eb-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:22 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb" returned: 0 in 0.394s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598498883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d420e5-8aa8-42e8-a644-7cbf13ebdaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:22Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Creating volume 19d420e5-8aa8-42e8-a644-7cbf13ebdaeb {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:22 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682d5946-6c5d-4f82-aa82-7f1018bac921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d27d12-cdbb-4883-a30a-eb440baf2265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:22 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb 1073741824 Sep 07 11:10:22 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-f45d79b3-3763-445b-9a4e-9cc9e055e7eb" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:22 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb (949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb): created successfully Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d27d12-cdbb-4883-a30a-eb440baf2265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (687d9f59-4a55-48fe-bffe-9b9cbed969a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c1ba8594-d355-4144-8bee-d1d164411432 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created volume successfully. Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-f45d79b3-3763-445b-9a4e-9cc9e055e7eb" acquired by "delete_volume" :: waited 0.046s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01576f1-58ee-4dfb-9b57-392a4c9c818e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:23 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb Sep 07 11:10:23 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (4e2d406b-a1bb-4233-bab0-79d6428ecc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfc996f-0ff4-4d3d-a243-e216ddd66e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfc996f-0ff4-4d3d-a243-e216ddd66e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52249687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2624c64d-5db6-4820-a585-75310a41e98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:23Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d09081-7fec-4f26-bfb9-4dbd799dd2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d09081-7fec-4f26-bfb9-4dbd799dd2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7f7dba-a213-4c70-b5db-97efb7499746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7f7dba-a213-4c70-b5db-97efb7499746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2624c64d-5db6-4820-a585-75310a41e98f', 'volume_name': 'volume-2624c64d-5db6-4820-a585-75310a41e98f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099a7a16-dc58-4f83-af19-e297ee00c983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099a7a16-dc58-4f83-af19-e297ee00c983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f294aa26-1136-4579-9427-c0ad12efb49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume 2624c64d-5db6-4820-a585-75310a41e98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2624c64d-5db6-4820-a585-75310a41e98f', 'volume_size': 1} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:23 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb" returned: 0 in 0.498s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:23 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb Sep 07 11:10:23 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:23 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (60560eba-cc57-495b-b209-7e96ad0d99fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c7cf48-dcd6-4e6b-a46a-4e31033eba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb 1073741824" returned: 0 in 0.795s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c7cf48-dcd6-4e6b-a46a-4e31033eba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628052571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43588df-492e-496c-9e6d-54d6ee9ad387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:23Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bc2222-7045-4a02-a4ca-4ce9bc63b1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bc2222-7045-4a02-a4ca-4ce9bc63b1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a473f807-592b-4621-9d4f-4a3a2ba08f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a473f807-592b-4621-9d4f-4a3a2ba08f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43588df-492e-496c-9e6d-54d6ee9ad387', 'volume_name': 'volume-d43588df-492e-496c-9e6d-54d6ee9ad387', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c6c43c-3d6b-4989-98de-5c4d8e565962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c6c43c-3d6b-4989-98de-5c4d8e565962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88ff621-c730-4edd-830b-9487d2332b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume d43588df-492e-496c-9e6d-54d6ee9ad387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43588df-492e-496c-9e6d-54d6ee9ad387', 'volume_size': 1} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" acquired by "delete_volume" :: waited 0.045s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:23 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb Sep 07 11:10:23 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[432abdb1-36cf-4ac0-94d1-0aeb3facc145]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:23 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f45d79b3-3763-445b-9a4e-9cc9e055e7eb" returned: 0 in 0.414s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-f45d79b3-3763-445b-9a4e-9cc9e055e7eb" released by "delete_volume" :: held 0.983s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:23 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 Sep 07 11:10:23 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created reservations ['74c7cdf5-bbc5-47ea-8d31-ba3a81a1b988', 'de70aaea-0176-454d-b8da-d48c81c29da9', '3436efa9-562d-4edc-88ec-ba6ccde9c667', 'c97d3f10-955d-46fc-afe5-8728977b5cd0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:23 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb" returned: 0 in 0.333s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502845232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6174ad5-1701-4998-89e4-7086825e3b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:22Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Creating volume b6174ad5-1701-4998-89e4-7086825e3b62 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:23 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:23 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 1073741824 Sep 07 11:10:23 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998feff2-b483-47c0-bbb6-7f19ff4ebbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9dac46a-3b23-47bb-8fa3-54d639ae9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:23 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb (19d420e5-8aa8-42e8-a644-7cbf13ebdaeb): created successfully Sep 07 11:10:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9dac46a-3b23-47bb-8fa3-54d639ae9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (d3aee179-7cb7-41e5-bc10-52586da4ecfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5f046d12-a7c5-4654-9d8e-0dcb8cfffe2a tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created volume successfully. Sep 07 11:10:24 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:24 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:24 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" returned: 0 in 0.419s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:24 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41 Sep 07 11:10:24 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:24 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.275s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Deleted volume successfully. Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d065ce0-030b-4ef7-89e7-f58c778452b1 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-f45d79b3-3763-445b-9a4e-9cc9e055e7eb-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:24 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" returned: 0 in 0.285s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41" released by "delete_volume" :: held 0.798s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:24 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 1073741824" returned: 0 in 0.494s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:24 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 Sep 07 11:10:24 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Created reservations ['46251816-ff52-42da-9913-a0618b34d6c4', 'd1580bfc-28c1-4f8a-bbdb-d4ee8deae0e9', 'f7247f3f-4555-4472-9b1b-4f646e0146c7', 'f5fd3353-58bd-48ae-b89f-71ab36868d7a'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:24 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:24 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:24 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62" returned: 0 in 0.280s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52249687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2624c64d-5db6-4820-a585-75310a41e98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:23Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Creating volume 2624c64d-5db6-4820-a585-75310a41e98f {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:24 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f 1073741824 Sep 07 11:10:24 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2e7099-b4f5-4b54-9f70-19162a6bccaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6174ad5-1701-4998-89e4-7086825e3b62', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4d9eb8-7d91-4030-a9c0-f7e708b9d84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:24 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume volume-b6174ad5-1701-4998-89e4-7086825e3b62 (b6174ad5-1701-4998-89e4-7086825e3b62): created successfully Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4d9eb8-7d91-4030-a9c0-f7e708b9d84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (73e0efd7-b58f-4cd9-933e-e8e874f1b846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-70a8b7dd-e824-470b-a99e-153fc95e3ed8-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.302s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:10:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-afd1c3d6-6407-409b-9210-0d5fdd8de072 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created volume successfully. Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cd62c4de-7023-4201-ae90-d07764fcf8e4 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7a6c4df0-b7df-4ec7-a5af-6d8b25514c41-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-70a8b7dd-e824-470b-a99e-153fc95e3ed8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-70a8b7dd-e824-470b-a99e-153fc95e3ed8" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-70a8b7dd-e824-470b-a99e-153fc95e3ed8" acquired by "delete_volume" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:24 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c44de88-b34e-437e-b673-55c65f3421f4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:25 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 Sep 07 11:10:25 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:25 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f 1073741824" returned: 0 in 0.539s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:25 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f Sep 07 11:10:25 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:25 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8" returned: 0 in 0.424s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:25 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8 Sep 07 11:10:25 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:25 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f" returned: 0 in 0.306s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628052571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43588df-492e-496c-9e6d-54d6ee9ad387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37007d37bf9a4816b6a96b4e6a16cd67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:23Z,use_quota=True,user_id='161a2c55eb0042c783dd2622ab823269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Creating volume d43588df-492e-496c-9e6d-54d6ee9ad387 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:25 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:25 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 1073741824 Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f294aa26-1136-4579-9427-c0ad12efb49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2624c64d-5db6-4820-a585-75310a41e98f', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:25 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fc36de-9fda-4795-a2f2-503d1ecc0f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:25 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-70a8b7dd-e824-470b-a99e-153fc95e3ed8" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume volume-2624c64d-5db6-4820-a585-75310a41e98f (2624c64d-5db6-4820-a585-75310a41e98f): created successfully Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fc36de-9fda-4795-a2f2-503d1ecc0f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (4e2d406b-a1bb-4233-bab0-79d6428ecc26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-70a8b7dd-e824-470b-a99e-153fc95e3ed8" released by "delete_volume" :: held 0.821s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0a24ccde-090c-4402-b31e-709a8aae76bb tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created volume successfully. Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created reservations ['122b91a7-f3dc-4da4-89c9-465ee1ca95ec', '7d8326d7-377e-4a10-93af-b89f66ee3a74', '39962d18-ceff-48f5-9e1c-809908705662', '62b67bb9-e4c8-42ec-9081-a7ae1ec56d87'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:26 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:26 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-d9daa6ff-ed77-43b4-9256-11181b81011f-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-d9daa6ff-ed77-43b4-9256-11181b81011f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-e6af89c9-28bb-4ff6-a86e-24545b5947c5" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-e6af89c9-28bb-4ff6-a86e-24545b5947c5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-d9daa6ff-ed77-43b4-9256-11181b81011f" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-d9daa6ff-ed77-43b4-9256-11181b81011f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Deleting offline snapshot d9daa6ff-ed77-43b4-9256-11181b81011f of volume e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] snapshot_file for this snap is: volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4888305-1cc8-4e40-b6bc-326baa067dad]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:26 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.305s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:26 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Deleted volume successfully. Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 1073741824" returned: 0 in 0.641s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5dda16b4-985d-4406-b7d4-f7a7a41c0264 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-70a8b7dd-e824-470b-a99e-153fc95e3ed8-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:26 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f Sep 07 11:10:26 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:26 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 Sep 07 11:10:26 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (e92bf931-c435-43f6-b4b0-0d5a9ebe7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10981d1-ff51-4518-99a8-5b0d2936b05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10981d1-ff51-4518-99a8-5b0d2936b05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671666694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c786db-2b7c-40dd-93d1-7d298c4652d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:26Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424939c3-913c-4510-9c03-b87bd8275dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424939c3-913c-4510-9c03-b87bd8275dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4649f3e-9000-4a96-9a1b-e56ad15a0599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4649f3e-9000-4a96-9a1b-e56ad15a0599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c786db-2b7c-40dd-93d1-7d298c4652d7', 'volume_name': 'volume-45c786db-2b7c-40dd-93d1-7d298c4652d7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:26 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff3a834-f56a-478b-8a29-eb4cea9cc638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff3a834-f56a-478b-8a29-eb4cea9cc638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1fab84-77d6-49cf-85b5-693e3acf3764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:26 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Volume 45c786db-2b7c-40dd-93d1-7d298c4652d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c786db-2b7c-40dd-93d1-7d298c4652d7', 'volume_size': 1} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:26 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387" returned: 0 in 0.334s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671666694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c786db-2b7c-40dd-93d1-7d298c4652d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:26Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Creating volume 45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:26 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f" returned: 0 in 0.475s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:10:26 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 1073741824 Sep 07 11:10:26 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88ff621-c730-4edd-830b-9487d2332b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43588df-492e-496c-9e6d-54d6ee9ad387', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1256e904-832f-440a-8c8f-1941f8aeb0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b20a91-d7f0-49a1-a5a2-83ddab153d33]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:26 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Volume volume-d43588df-492e-496c-9e6d-54d6ee9ad387 (d43588df-492e-496c-9e6d-54d6ee9ad387): created successfully Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1256e904-832f-440a-8c8f-1941f8aeb0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:26 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Flow 'volume_create_manager' (60560eba-cc57-495b-b209-7e96ad0d99fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-884c855f-8ea5-4dc8-b970-c35e772bae20 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created volume successfully. Sep 07 11:10:26 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 Sep 07 11:10:26 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:27 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5" returned: 0 in 0.399s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:27 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 1073741824" returned: 0 in 0.488s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:27 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f Sep 07 11:10:27 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:27 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 Sep 07 11:10:27 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:27 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7" returned: 0 in 0.287s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1fab84-77d6-49cf-85b5-693e3acf3764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c786db-2b7c-40dd-93d1-7d298c4652d7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec15ed2-4efe-4713-bc7d-c7edff04702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:27 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:27 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Volume volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 (45c786db-2b7c-40dd-93d1-7d298c4652d7): created successfully Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec15ed2-4efe-4713-bc7d-c7edff04702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (e92bf931-c435-43f6-b4b0-0d5a9ebe7022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f" returned: 0 in 0.413s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:27 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c5dfdc5b-fbdf-4993-a738-3ffb92002146 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:10:27 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f Sep 07 11:10:27 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:27 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5.d9daa6ff-ed77-43b4-9256-11181b81011f" returned: 0 in 0.261s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-d9daa6ff-ed77-43b4-9256-11181b81011f" released by "_delete_snapshot" :: held 1.686s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-e6af89c9-28bb-4ff6-a86e-24545b5947c5" released by "delete_snapshot" :: held 1.730s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-d43588df-492e-496c-9e6d-54d6ee9ad387-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-d43588df-492e-496c-9e6d-54d6ee9ad387-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:27 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-quobyte-d43588df-492e-496c-9e6d-54d6ee9ad387" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-d43588df-492e-496c-9e6d-54d6ee9ad387" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created reservations ['fbd2fec8-4975-4fd9-9ae6-6882c79a4c66', 'efe6ef2e-0b8d-4f15-b4f6-dd4a746d78e8', '75cb6eaa-e9d4-4d63-905b-8fbdbe1f48e2', '6b675550-5896-4ed9-8ccd-dd1f7dda35d7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f17ee87-91e0-4471-ae07-e12cdbbee44b]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:28 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Delete snapshot completed successfully. Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7878d6a8-11ee-487b-8f49-fa0b510daf0b tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-d9daa6ff-ed77-43b4-9256-11181b81011f-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:28 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 Sep 07 11:10:28 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-e6af89c9-28bb-4ff6-a86e-24545b5947c5-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-e6af89c9-28bb-4ff6-a86e-24545b5947c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "cinder-quobyte-e6af89c9-28bb-4ff6-a86e-24545b5947c5" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-e6af89c9-28bb-4ff6-a86e-24545b5947c5" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[647e84e1-3d4a-4aed-ae77-99843729a7c8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:28 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387" returned: 0 in 0.584s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:28 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 Sep 07 11:10:28 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387 Sep 07 11:10:28 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:28 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot 7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 of volume 45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f9eaaa-37a1-4a52-a41f-5264bb988cfc]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:28 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 Sep 07 11:10:28 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:28 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d43588df-492e-496c-9e6d-54d6ee9ad387" returned: 0 in 0.328s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:28 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-d43588df-492e-496c-9e6d-54d6ee9ad387" released by "delete_volume" :: held 0.962s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:29 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5" returned: 0 in 0.587s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:29 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5 Sep 07 11:10:29 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created reservations ['7fe18c7f-7abd-495e-bed5-d13f5bee126f', 'f8dd7edc-cc08-4aec-82b2-00f869c2f69a', '095ebab1-4fe1-4169-ae29-516327882008', '6c593bfe-e6e1-4661-a954-898ce4a6298d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:29 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:29 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:29 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7" returned: 0 in 0.515s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:29 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 1G Sep 07 11:10:29 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:29 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e6af89c9-28bb-4ff6-a86e-24545b5947c5" returned: 0 in 0.343s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-quobyte-e6af89c9-28bb-4ff6-a86e-24545b5947c5" released by "delete_volume" :: held 1.030s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:29 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.285s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Created reservations ['019179d7-2037-4881-82bc-94472eb4f92c', 'a7f192c6-4995-4748-b534-213b2117db00', 'f6ab9769-8077-46e2-8b86-02bb78883c1e', '8b90deff-9077-4bd8-89f0-04fd80122804'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:29 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Deleted volume successfully. Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7df7cabb-a56d-4daf-b4c4-6eed86a4ebcf tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-d43588df-492e-496c-9e6d-54d6ee9ad387-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:29 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:29 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:29 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 1G" returned: 0 in 0.523s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:29 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 Sep 07 11:10:29 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:29 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.288s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:29 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Deleted volume successfully. Sep 07 11:10:29 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-7a73ecde-266e-472d-9008-536bcb94b067 tempest-CreateVolumesFromSnapshotTest-1818479490 None] Lock "cinder-e6af89c9-28bb-4ff6-a86e-24545b5947c5-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:30 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" returned: 0 in 0.327s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:30 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 is being set with open permissions: ugo+rw Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:30 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 Sep 07 11:10:30 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-2624c64d-5db6-4820-a585-75310a41e98f-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-2624c64d-5db6-4820-a585-75310a41e98f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-quobyte-2624c64d-5db6-4820-a585-75310a41e98f" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-2624c64d-5db6-4820-a585-75310a41e98f" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5904b8-f668-46ca-9678-f5ddc4711906]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:30 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" returned: 0 in 0.318s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:30 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f Sep 07 11:10:30 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:30 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.info Sep 07 11:10:30 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:30 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.info" returned: 0 in 0.334s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:30 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.info is being set with open permissions: ugo+rw Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:30 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.info Sep 07 11:10:30 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:30 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f" returned: 0 in 0.524s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:30 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:30 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f Sep 07 11:10:30 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:31 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.info" returned: 0 in 0.317s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:31 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2624c64d-5db6-4820-a585-75310a41e98f" returned: 0 in 0.291s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-2624c64d-5db6-4820-a585-75310a41e98f" released by "delete_volume" :: held 0.876s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c37f19e7-a29a-482b-a834-31e725faec85 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created reservations ['7de7fbdb-2b83-4484-9e66-8311f7c8190a', '130519a8-16a0-40b7-adb4-cbdf749a13e7', 'b9243d2a-293f-4f9d-9d16-4f4282e379c0', '3b244d8e-d31d-4e44-aade-af25b5c7ae0c'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:31 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:31 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-b6174ad5-1701-4998-89e4-7086825e3b62-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-b6174ad5-1701-4998-89e4-7086825e3b62-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-quobyte-b6174ad5-1701-4998-89e4-7086825e3b62" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-b6174ad5-1701-4998-89e4-7086825e3b62" acquired by "delete_volume" :: waited 0.051s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9855ace7-3e1d-4228-ab56-5f3c88c7834d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:31 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.573s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Deleted volume successfully. Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Lock "cinder-7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-45c786db-2b7c-40dd-93d1-7d298c4652d7" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5320750d-bc45-452a-b820-6fa96b7cccbe tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-2624c64d-5db6-4820-a585-75310a41e98f-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:32 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 Sep 07 11:10:32 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-45c786db-2b7c-40dd-93d1-7d298c4652d7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot 7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 of volume 45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca29d52-cc52-4cc7-bd41-f4089df61c47]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:32 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 Sep 07 11:10:32 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:32 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62" returned: 0 in 0.571s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:32 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62 Sep 07 11:10:32 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:32 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" returned: 0 in 0.484s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c786db-2b7c-40dd-93d1-7d298c4652d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e22edc-3d86-4f0e-82e2-5fd88ed58c13]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:32 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b6174ad5-1701-4998-89e4-7086825e3b62" returned: 0 in 0.332s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-b6174ad5-1701-4998-89e4-7086825e3b62" released by "delete_volume" :: held 1.012s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:32 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created reservations ['f31a6e4a-4d58-40c1-a3a8-15132c5ef457', '138e9712-8792-4b7f-b115-db9855bd50fc', '536551b1-5074-49ab-9af1-67097c0d639f', 'd3376ff6-6684-4efe-8858-7407dd0ecee4'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:32 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:32 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:32 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:33 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7" returned: 0 in 0.492s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:33 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 Sep 07 11:10:33 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:33 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.298s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Deleted volume successfully. Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5ed8b87b-5ad3-4907-916d-4a2555cec33f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-b6174ad5-1701-4998-89e4-7086825e3b62-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:33 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" returned: 0 in 0.440s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:33 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7 Sep 07 11:10:33 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:33 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7.7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" returned: 0 in 0.321s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7" released by "_delete_snapshot" :: held 1.890s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-45c786db-2b7c-40dd-93d1-7d298c4652d7" released by "delete_snapshot" :: held 1.936s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-quobyte-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:33 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b91d81-eb59-4749-886f-9873af0f8589]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Created reservations ['e1d8e70d-a463-422f-9b96-3c335c4b9d59', '6814e757-b3de-48b4-b387-3d0829f195df', 'fc12f313-a130-4d05-9370-14a60c2a4303', '8e7ee96a-f4b3-4b3d-9077-d2436ae54aad'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:34 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb Sep 07 11:10:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:10:34 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-91e6f022-77e5-4d46-b14e-044d4b985dcd tempest-ProjectMemberTests-652306273 None] Lock "cinder-7750d8bf-90a8-4c80-ac2e-8e74adc2d3c7-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:34 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb" returned: 0 in 0.441s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:34 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb Sep 07 11:10:34 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:34 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb" returned: 0 in 0.277s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb" released by "delete_volume" :: held 0.772s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created reservations ['27dc87d6-0ca5-4916-a5d4-ceea959a6267', 'a6be92c5-ad20-4dba-b8ae-21e6e271872f', '57d72f0b-2854-4741-b3dc-17efa24b8180', '4862518b-b4ed-432d-824c-b0bca40d6ea0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:34 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:34 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-quobyte-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:35 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.325s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[724d0f45-f30a-4156-8706-e292e00cda79]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Deleted volume successfully. Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-da7f0881-7390-4ed0-b0c1-05699a847f3c tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-19d420e5-8aa8-42e8-a644-7cbf13ebdaeb-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-45c786db-2b7c-40dd-93d1-7d298c4652d7-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Lock "cinder-45c786db-2b7c-40dd-93d1-7d298c4652d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:35 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb Sep 07 11:10:35 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-45c786db-2b7c-40dd-93d1-7d298c4652d7" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-45c786db-2b7c-40dd-93d1-7d298c4652d7" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd205bf8-34cd-499c-8eb8-a5c4629fc500]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:35 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 Sep 07 11:10:35 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:35 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb" returned: 0 in 0.538s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:35 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb Sep 07 11:10:35 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:35 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7" returned: 0 in 0.514s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:36 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7 Sep 07 11:10:36 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:36 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb" returned: 0 in 0.315s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb" released by "delete_volume" :: held 0.920s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created reservations ['95e94be5-dcb1-4604-a68d-4b1405725c8c', '427c8330-2bf7-4d19-938a-341831dac95d', '774580d8-6d87-45b4-bfbb-cba8f369bd69', '6e91a796-89c7-48d4-b3ea-60b6a5bd4722'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:36 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-45c786db-2b7c-40dd-93d1-7d298c4652d7" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:36 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:36 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-45c786db-2b7c-40dd-93d1-7d298c4652d7" released by "delete_volume" :: held 0.952s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-8b73105a-4c21-4845-a7e7-915e3ed702da-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-8b73105a-4c21-4845-a7e7-915e3ed702da-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Created reservations ['f03138fc-89c6-4b7e-8517-ac12f518b445', '795a1f4f-2768-4a0d-b325-1da8d5724dfb', '92f54f05-aefd-40bf-8589-28950c487c0b', 'd358c909-1606-40dd-bb1a-9cada3b92984'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "cinder-quobyte-8b73105a-4c21-4845-a7e7-915e3ed702da" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-8b73105a-4c21-4845-a7e7-915e3ed702da" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfcf9ff-b117-4580-8d34-6a230eced398]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:36 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.431s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:36 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:36 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:36 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Deleted volume successfully. Sep 07 11:10:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-a7221c6b-6f45-40cf-9ce7-27a0658a91f2 tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-949a2d7a-fdfc-4fe8-bd00-2eb60766a2bb-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:36 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da Sep 07 11:10:36 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:37 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.294s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-15679a02-a362-469d-b477-d5f5fe3324ea tempest-ProjectMemberTests-652306273 None] Lock "cinder-45c786db-2b7c-40dd-93d1-7d298c4652d7-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:37 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da" returned: 0 in 0.495s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:37 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da Sep 07 11:10:37 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:37 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-8b73105a-4c21-4845-a7e7-915e3ed702da" returned: 0 in 0.298s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-quobyte-8b73105a-4c21-4845-a7e7-915e3ed702da" released by "delete_volume" :: held 0.860s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Created reservations ['56e10487-f170-48be-8804-3e0cc9d9255f', '81de0cc9-3f6b-46e0-9289-e50b8a03f8f4', '6f84c15e-ec08-4feb-8648-af394826228e', 'e7b62c82-7ff3-4cc7-928c-c738b2a587f7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:37 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:37 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:37 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Flow 'volume_create_manager' (d15f7a7c-e1a2-4931-90a5-1069e5b83095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9517539-84a1-4992-8a56-212d2f3f0f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.341s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Deleted volume successfully. Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9517539-84a1-4992-8a56-212d2f3f0f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd65bd90-799f-4d43-a75b-f88f288b6a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c18a4e3f17c49c5ba5eacd14b16d55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:38Z,use_quota=True,user_id='685e2b45c47946faa258e76b1f3f6b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf25168-d922-4447-85c8-6e363dafc75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf25168-d922-4447-85c8-6e363dafc75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608e186e-4a09-4120-8ed3-e4aa7b122245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.image.glance [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Creating Keystone auth plugin from conf {{(pid=87271) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-663d28eb-c5f6-4077-aeda-3a53c044ef4f tempest-CreateVolumesFromSourceVolumeTest-925546897 None] Lock "cinder-8b73105a-4c21-4845-a7e7-915e3ed702da-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (74305149-dee9-4ced-82f7-eb6c04332281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563f0f29-3df0-47f9-a131-9bc30a721057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563f0f29-3df0-47f9-a131-9bc30a721057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627667910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de556c8b-791e-40c4-8d1c-53a04e449fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:38Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1847b8-3f95-42af-ae98-8cb16ec93ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1847b8-3f95-42af-ae98-8cb16ec93ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b66203-5c0e-4ac2-b92d-9110a22a9905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b66203-5c0e-4ac2-b92d-9110a22a9905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de556c8b-791e-40c4-8d1c-53a04e449fcf', 'volume_name': 'volume-de556c8b-791e-40c4-8d1c-53a04e449fcf', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4aae41-fb86-44aa-8403-8771dacc587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4aae41-fb86-44aa-8403-8771dacc587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9266aefc-d26a-4e57-8f98-89b87ca996e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Volume de556c8b-791e-40c4-8d1c-53a04e449fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de556c8b-791e-40c4-8d1c-53a04e449fcf', 'volume_size': 1} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627667910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de556c8b-791e-40c4-8d1c-53a04e449fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:38Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Creating volume de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:38 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:38 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf 1073741824 Sep 07 11:10:38 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608e186e-4a09-4120-8ed3-e4aa7b122245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd65bd90-799f-4d43-a75b-f88f288b6a61', 'volume_name': 'volume-fd65bd90-799f-4d43-a75b-f88f288b6a61', 'volume_size': 1, 'image_id': '729e0e47-e8b5-4121-a0d4-f5470204801e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/729e0e47-e8b5-4121-a0d4-f5470204801e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f860764e6c6827d3c36eff50d86cbc0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c18a4e3f17c49c5ba5eacd14b16d55a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca7fb83d973e04e2efb10271869544e0e8da696e6ac929041e8a7790472684689fa3fb55a01da05ff83234cd652e1dec9768093d6d94df5b71b6315060a46fa2', 'id': '729e0e47-e8b5-4121-a0d4-f5470204801e', 'created_at': datetime.datetime(2026, 9, 7, 9, 10, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 10, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/729e0e47-e8b5-4121-a0d4-f5470204801e/file', 'properties': {}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31718c91-a53b-4fbc-b68f-23a6944ba5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31718c91-a53b-4fbc-b68f-23a6944ba5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b05568b-2058-4514-b4d7-7ff6355ca4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Volume fd65bd90-799f-4d43-a75b-f88f288b6a61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd65bd90-799f-4d43-a75b-f88f288b6a61', 'volume_size': 1, 'image_id': '729e0e47-e8b5-4121-a0d4-f5470204801e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/729e0e47-e8b5-4121-a0d4-f5470204801e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f860764e6c6827d3c36eff50d86cbc0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c18a4e3f17c49c5ba5eacd14b16d55a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca7fb83d973e04e2efb10271869544e0e8da696e6ac929041e8a7790472684689fa3fb55a01da05ff83234cd652e1dec9768093d6d94df5b71b6315060a46fa2', 'id': '729e0e47-e8b5-4121-a0d4-f5470204801e', 'created_at': datetime.datetime(2026, 9, 7, 9, 10, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 10, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/729e0e47-e8b5-4121-a0d4-f5470204801e/file', 'properties': {}}, 'image_service': } Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Trying to clone fd65bd90-799f-4d43-a75b-f88f288b6a61 from image 729e0e47-e8b5-4121-a0d4-f5470204801e at location (None, [{'url': 'file:///opt/stack/data/glance/images/729e0e47-e8b5-4121-a0d4-f5470204801e', 'metadata': {}}]). {{(pid=87271) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 11:10:38 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Image download 0.00 MB at 0.00 MB/s Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[94357cc1-fc7d-43ec-a0bb-74bd2a4fbc55]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:39 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD Sep 07 11:10:39 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:39 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf 1073741824" returned: 0 in 0.608s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:39 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf Sep 07 11:10:39 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:39 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:39 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf" returned: 0 in 0.333s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9266aefc-d26a-4e57-8f98-89b87ca996e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de556c8b-791e-40c4-8d1c-53a04e449fcf', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fdbcf5-66c1-4225-a32c-846f84e14c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:39 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Volume volume-de556c8b-791e-40c4-8d1c-53a04e449fcf (de556c8b-791e-40c4-8d1c-53a04e449fcf): created successfully Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fdbcf5-66c1-4225-a32c-846f84e14c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (74305149-dee9-4ced-82f7-eb6c04332281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6f363da2-414b-4f9e-b368-8380af3248d5 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:10:39 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD Sep 07 11:10:39 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:39 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:39 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Temporary image 729e0e47-e8b5-4121-a0d4-f5470204801e is fetched for user 685e2b45c47946faa258e76b1f3f6b84. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed31ca5-5e63-4c35-9cd0-9d3dc68ab196]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:40 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD Sep 07 11:10:40 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:40 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:40 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD Sep 07 11:10:40 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot 89bdf3d1-2f12-4d81-949c-1dc8936f7591 of volume de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[0661e246-4af9-4da6-bb3c-6c5ed7850ecf]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:40 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:41 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf Sep 07 11:10:41 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:41 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf" returned: 0 in 0.403s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:41 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 1G Sep 07 11:10:41 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Flow 'volume_create_manager' (8fb18c91-09a1-4197-94bc-bc5e94090b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6934c5ae-b0b8-461b-8333-32fda0a51803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6934c5ae-b0b8-461b-8333-32fda0a51803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998904986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5044623-7a2c-42dc-8cdf-4facd1f8b446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680fc97cdde34c10927edbcce632e875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:42Z,use_quota=True,user_id='b7aaf2e74a4f46c0b08c8dd9a4b1247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4f606c-7e4a-46d6-a1c7-e3247771c722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4f606c-7e4a-46d6-a1c7-e3247771c722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f2c48a-7002-4442-a217-62169040296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f2c48a-7002-4442-a217-62169040296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5044623-7a2c-42dc-8cdf-4facd1f8b446', 'volume_name': 'volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d94abf-4762-45f3-89bd-aa43f6957285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d94abf-4762-45f3-89bd-aa43f6957285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224efe4a-46a8-4c16-ba38-0396919727a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:41 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Volume b5044623-7a2c-42dc-8cdf-4facd1f8b446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446', 'volume_size': 1} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:41 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 1G" returned: 0 in 0.530s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de556c8b-791e-40c4-8d1c-53a04e449fcf -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:41 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de556c8b-791e-40c4-8d1c-53a04e449fcf -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 Sep 07 11:10:41 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:42 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de556c8b-791e-40c4-8d1c-53a04e449fcf -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591" returned: 0 in 0.306s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:42 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 is being set with open permissions: ugo+rw Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:42 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 Sep 07 11:10:42 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:42 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591" returned: 0 in 0.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:42 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.info Sep 07 11:10:42 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:42 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.info" returned: 0 in 0.256s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:42 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.info is being set with open permissions: ugo+rw Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:42 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.info Sep 07 11:10:42 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:42 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.info" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.032s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd65bd90-799f-4d43-a75b-f88f288b6a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c18a4e3f17c49c5ba5eacd14b16d55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:38Z,use_quota=True,user_id='685e2b45c47946faa258e76b1f3f6b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Creating volume fd65bd90-799f-4d43-a75b-f88f288b6a61 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:42 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:42 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 1073741824 Sep 07 11:10:42 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c4a88646-86c8-48d8-a6b6-f01830a2f8f5 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:10:43 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 1073741824" returned: 0 in 0.472s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:43 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 Sep 07 11:10:43 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:43 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61" returned: 0 in 0.254s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998904986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5044623-7a2c-42dc-8cdf-4facd1f8b446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680fc97cdde34c10927edbcce632e875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:42Z,use_quota=True,user_id='b7aaf2e74a4f46c0b08c8dd9a4b1247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Creating volume b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:43 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Attempting download of 729e0e47-e8b5-4121-a0d4-f5470204801e ((None, [{'url': 'file:///opt/stack/data/glance/images/729e0e47-e8b5-4121-a0d4-f5470204801e', 'metadata': {}}])) to volume fd65bd90-799f-4d43-a75b-f88f288b6a61. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 11:10:43 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 1073741824 Sep 07 11:10:43 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa596e4c-c86d-445a-9449-6d2485ba9927]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_729e0e47-e8b5-4121-a0d4-f5470204801e_prne8qok {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:43 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_729e0e47-e8b5-4121-a0d4-f5470204801e_prne8qok Sep 07 11:10:43 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-89bdf3d1-2f12-4d81-949c-1dc8936f7591-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Lock "cinder-89bdf3d1-2f12-4d81-949c-1dc8936f7591-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-de556c8b-791e-40c4-8d1c-53a04e449fcf" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-de556c8b-791e-40c4-8d1c-53a04e449fcf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-89bdf3d1-2f12-4d81-949c-1dc8936f7591" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-89bdf3d1-2f12-4d81-949c-1dc8936f7591" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot 89bdf3d1-2f12-4d81-949c-1dc8936f7591 of volume de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42d6cd1-0920-497c-b251-0b5a24123909]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:44 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_729e0e47-e8b5-4121-a0d4-f5470204801e_prne8qok" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_729e0e47-e8b5-4121-a0d4-f5470204801e_prne8qok {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:44 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 Sep 07 11:10:44 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:44 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_729e0e47-e8b5-4121-a0d4-f5470204801e_prne8qok Sep 07 11:10:44 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:44 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 1073741824" returned: 0 in 0.631s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:44 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 Sep 07 11:10:44 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:44 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_729e0e47-e8b5-4121-a0d4-f5470204801e_prne8qok" returned: 1 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_729e0e47-e8b5-4121-a0d4-f5470204801e_prne8qok' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd47b01-1bca-4928-8736-00615a6de241]: (4, 'raw') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:44 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591" returned: 0 in 0.470s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de556c8b-791e-40c4-8d1c-53a04e449fcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb315fd-026f-43fd-bba4-e53bf4d7daa4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:44 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD Sep 07 11:10:44 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:44 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446" returned: 0 in 0.335s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224efe4a-46a8-4c16-ba38-0396919727a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ef539b-e42a-4cd4-a13a-fd647456a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:44 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Volume volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 (b5044623-7a2c-42dc-8cdf-4facd1f8b446): created successfully Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ef539b-e42a-4cd4-a13a-fd647456a210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Flow 'volume_create_manager' (8fb18c91-09a1-4197-94bc-bc5e94090b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:44 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf Sep 07 11:10:44 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:44 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0e2e1cbc-70af-4cfd-8581-d5bb74adc737 tempest-VolumeDependencyTests-532566652 None] Created volume successfully. Sep 07 11:10:44 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:45 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD Sep 07 11:10:45 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:45 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf" returned: 0 in 0.476s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:45 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 Sep 07 11:10:45 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:45 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] 729e0e47-e8b5-4121-a0d4-f5470204801e was raw, converting to qcow2 {{(pid=87271) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:45 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 Sep 07 11:10:45 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:45 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591" returned: 0 in 0.397s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:45 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591 Sep 07 11:10:45 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:45 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf.89bdf3d1-2f12-4d81-949c-1dc8936f7591" returned: 0 in 0.297s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:45 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61" returned: 0 in 0.552s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_729e0e47-e8b5-4121-a0d4-f5470204801e_491der0xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:10:45 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-89bdf3d1-2f12-4d81-949c-1dc8936f7591" released by "_delete_snapshot" :: held 1.788s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-de556c8b-791e-40c4-8d1c-53a04e449fcf" released by "delete_snapshot" :: held 1.821s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:45 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 1G Sep 07 11:10:45 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:45 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Created reservations ['9bc9c45c-5550-4832-888d-ecbe749d2639', 'c455020f-d5fd-4b2c-adb6-2db7fb5061d5', '586cbfee-1b64-476d-9f93-6c3c652f9946', 'ed293829-3ab1-4c51-a9b8-409370fdc754'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f8759e85-6aea-4be1-8652-e8d7fd43739f tempest-ProjectMemberTests-652306273 None] Lock "cinder-89bdf3d1-2f12-4d81-949c-1dc8936f7591-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Creating offline snapshot 61234efc-f33d-4b5d-9750-f08b8de20cfc of volume b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ae0c0-57bf-4030-b5ab-955648c59c10]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-de556c8b-791e-40c4-8d1c-53a04e449fcf-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Lock "cinder-de556c8b-791e-40c4-8d1c-53a04e449fcf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:46 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 1G" returned: 0 in 0.435s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Downloaded image 729e0e47-e8b5-4121-a0d4-f5470204801e ((None, [{'url': 'file:///opt/stack/data/glance/images/729e0e47-e8b5-4121-a0d4-f5470204801e', 'metadata': {}}])) to volume fd65bd90-799f-4d43-a75b-f88f288b6a61 successfully. {{(pid=87271) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Temporary image 729e0e47-e8b5-4121-a0d4-f5470204801e for user 685e2b45c47946faa258e76b1f3f6b84 is deleted. {{(pid=87271) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.volume_utils [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Marking volume fd65bd90-799f-4d43-a75b-f88f288b6a61 as bootable. {{(pid=87271) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Copying metadata from image 729e0e47-e8b5-4121-a0d4-f5470204801e to fd65bd90-799f-4d43-a75b-f88f288b6a61. {{(pid=87271) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Creating volume glance metadata for volume fd65bd90-799f-4d43-a75b-f88f288b6a61 backed by image 729e0e47-e8b5-4121-a0d4-f5470204801e with: {'image_id': '729e0e47-e8b5-4121-a0d4-f5470204801e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7f860764e6c6827d3c36eff50d86cbc0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87271) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-de556c8b-791e-40c4-8d1c-53a04e449fcf" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:46 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 Sep 07 11:10:46 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-de556c8b-791e-40c4-8d1c-53a04e449fcf" acquired by "delete_volume" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[206fafc5-3b7a-4079-a497-80aab8a46475]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b05568b-2058-4514-b4d7-7ff6355ca4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd65bd90-799f-4d43-a75b-f88f288b6a61', 'volume_size': 1, 'image_id': '729e0e47-e8b5-4121-a0d4-f5470204801e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/729e0e47-e8b5-4121-a0d4-f5470204801e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f860764e6c6827d3c36eff50d86cbc0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c18a4e3f17c49c5ba5eacd14b16d55a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca7fb83d973e04e2efb10271869544e0e8da696e6ac929041e8a7790472684689fa3fb55a01da05ff83234cd652e1dec9768093d6d94df5b71b6315060a46fa2', 'id': '729e0e47-e8b5-4121-a0d4-f5470204801e', 'created_at': datetime.datetime(2026, 9, 7, 9, 10, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 9, 10, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/729e0e47-e8b5-4121-a0d4-f5470204801e/file', 'properties': {}}, 'image_service': }' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e9addc-7e7f-426b-a7ac-42c981e72178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:46 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Volume volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 (fd65bd90-799f-4d43-a75b-f88f288b6a61): created successfully Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e9addc-7e7f-426b-a7ac-42c981e72178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Flow 'volume_create_manager' (d15f7a7c-e1a2-4931-90a5-1069e5b83095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-805dfcff-c0cf-48f0-bac2-8f564f95d618 tempest-VolumeImageDependencyTests-1977635148 None] Created volume successfully. Sep 07 11:10:46 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf Sep 07 11:10:46 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:46 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446" returned: 0 in 0.600s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:46 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc 1G Sep 07 11:10:46 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:46 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf" returned: 0 in 0.493s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:46 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf Sep 07 11:10:46 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:47 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-de556c8b-791e-40c4-8d1c-53a04e449fcf" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-de556c8b-791e-40c4-8d1c-53a04e449fcf" released by "delete_volume" :: held 0.854s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:47 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc 1G" returned: 0 in 0.475s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:47 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc Sep 07 11:10:47 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Created reservations ['9a4c5152-d934-4f7e-84be-b29b2f633752', 'fa8e6b85-3a86-437c-b57d-3f12164b99aa', 'f9d81ec2-68f5-4c9f-8e7c-bf8cefbec556', '420d1d62-1543-4c61-81f3-540978767cd1'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:47 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:47 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Acquiring lock "cinder-fd65bd90-799f-4d43-a75b-f88f288b6a61-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Lock "cinder-fd65bd90-799f-4d43-a75b-f88f288b6a61-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:47 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc" returned: 0 in 0.429s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:47 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc is being set with open permissions: ugo+rw Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:47 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc Sep 07 11:10:47 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Acquiring lock "cinder-quobyte-fd65bd90-799f-4d43-a75b-f88f288b6a61" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Lock "cinder-quobyte-fd65bd90-799f-4d43-a75b-f88f288b6a61" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[045f8cf2-06ee-449a-8f2c-90517de71584]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:47 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.360s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:47 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:10:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-cf5f237f-5f90-4b77-86ea-4b667800f810 tempest-ProjectMemberTests-652306273 None] Lock "cinder-de556c8b-791e-40c4-8d1c-53a04e449fcf-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:47 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 Sep 07 11:10:47 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:48 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc" returned: 0 in 0.347s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:48 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.info Sep 07 11:10:48 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:48 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61" returned: 0 in 0.405s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:48 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61 Sep 07 11:10:48 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:48 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.info" returned: 0 in 0.327s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:48 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.info is being set with open permissions: ugo+rw Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:48 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.info Sep 07 11:10:48 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:48 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fd65bd90-799f-4d43-a75b-f88f288b6a61" returned: 0 in 0.323s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Lock "cinder-quobyte-fd65bd90-799f-4d43-a75b-f88f288b6a61" released by "delete_volume" :: held 0.784s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Created reservations ['ad231f3c-bd7d-4d2c-83a3-51d5cb0fab81', 'a74cfd45-b94a-46fc-ba6a-37aa5d9f90a4', '1a435ffc-bd4a-4d16-88af-f0b8e1033e16', '5085fa08-d05b-42b8-ac7f-dce4f729ad61'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:48 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:10:48 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:48 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.info" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:48 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-68fcbf71-42fa-4c5a-a9bc-5ef3be1fbf05 tempest-VolumeDependencyTests-532566652 None] Create snapshot completed successfully Sep 07 11:10:49 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.431s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:10:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Deleted volume successfully. Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (162dc1b2-c1e6-4e87-85e6-b51d5e67de49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9238a241-004d-4215-b34f-03ce42cd6d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-89ebe2dd-6d30-4d4b-9bdc-d3fc3800f440 tempest-VolumeImageDependencyTests-1977635148 None] Lock "cinder-fd65bd90-799f-4d43-a75b-f88f288b6a61-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9238a241-004d-4215-b34f-03ce42cd6d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055141008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8c47ab-0dfd-4fc6-ba84-43d046120dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:49Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c308408a-d91f-4ba9-98a4-603d8e2038ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c308408a-d91f-4ba9-98a4-603d8e2038ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e202f0-e260-49b8-84dc-1f9d267ca19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e202f0-e260-49b8-84dc-1f9d267ca19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8c47ab-0dfd-4fc6-ba84-43d046120dc3', 'volume_name': 'volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5feb1b-222e-4740-ae3d-61040f852052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5feb1b-222e-4740-ae3d-61040f852052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5586f0c2-117a-4197-bbe1-267a8eb963a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:49 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Volume cf8c47ab-0dfd-4fc6-ba84-43d046120dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3', 'volume_size': 1} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055141008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8c47ab-0dfd-4fc6-ba84-43d046120dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:49Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Creating volume cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:49 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:49 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 1073741824 Sep 07 11:10:49 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:49 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 1073741824" returned: 0 in 0.600s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:50 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 Sep 07 11:10:50 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Flow 'volume_create_manager' (3b1a37c3-dbb2-42c0-8151-dc2cf9430774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1734effd-a84c-43cf-b72e-ae4d7b4faf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1734effd-a84c-43cf-b72e-ae4d7b4faf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1200779960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c4b858-6c31-4f5d-9bec-8f5fe4b78571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680fc97cdde34c10927edbcce632e875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61234efc-f33d-4b5d-9750-f08b8de20cfc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:50Z,use_quota=True,user_id='b7aaf2e74a4f46c0b08c8dd9a4b1247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c070c9-5032-47f5-b166-2d640193c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c070c9-5032-47f5-b166-2d640193c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c37d37-b753-4a63-af25-28f42872bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c37d37-b753-4a63-af25-28f42872bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6c4b858-6c31-4f5d-9bec-8f5fe4b78571', 'volume_name': 'volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571', 'volume_size': 1, 'snapshot_id': '61234efc-f33d-4b5d-9750-f08b8de20cfc'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b44602-07ca-42d7-85bf-908e2c680c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b44602-07ca-42d7-85bf-908e2c680c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe344a23-092e-4d53-b848-ba29fc82a697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:50 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Volume d6c4b858-6c31-4f5d-9bec-8f5fe4b78571: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571', 'volume_size': 1, 'snapshot_id': '61234efc-f33d-4b5d-9750-f08b8de20cfc'} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:50 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" returned: 0 in 0.326s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.120s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-quobyte-61234efc-f33d-4b5d-9750-f08b8de20cfc-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5586f0c2-117a-4197-bbe1-267a8eb963a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404e372c-13b9-4493-9252-82fe42b5aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-61234efc-f33d-4b5d-9750-f08b8de20cfc-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Creating volume d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 from snapshot 61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-quobyte-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:50 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Volume volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 (cf8c47ab-0dfd-4fc6-ba84-43d046120dc3): created successfully Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404e372c-13b9-4493-9252-82fe42b5aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (162dc1b2-c1e6-4e87-85e6-b51d5e67de49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] snapshot: 61234efc-f33d-4b5d-9750-f08b8de20cfc, volume: d6c4b858-6c31-4f5d-9bec-8f5fe4b78571, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:10:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-a416aab4-7e7d-46f1-a69a-6c4de2fd7f32 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5929e32f-7029-4347-b484-feb0a358eb4c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:50 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc Sep 07 11:10:50 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:50 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc" returned: 0 in 0.425s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e084cb9-1dc0-4497-ab76-67343d9d1fa5]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:51 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 Sep 07 11:10:51 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:51 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446" returned: 0 in 0.460s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:10:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:10:51 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:10:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:51 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 Sep 07 11:10:51 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:53 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:10:53 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Flow 'volume_create_manager' (85003eac-6ee6-45f8-b4a2-6dcc8068fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3029ba51-d90d-42e7-8546-3bf096a28717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3029ba51-d90d-42e7-8546-3bf096a28717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce045958-1079-41af-a91f-5fce5aa119f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ea932af9c41049c989e38ee4b368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:54Z,use_quota=True,user_id='7ea2e1a798f94adebae655d11f5a91b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ca7f48-ea41-4405-b7c8-6dd158a126a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ca7f48-ea41-4405-b7c8-6dd158a126a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a66adf-6380-4911-899b-112f4f657d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a66adf-6380-4911-899b-112f4f657d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce045958-1079-41af-a91f-5fce5aa119f8', 'volume_name': 'volume-ce045958-1079-41af-a91f-5fce5aa119f8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0211d8-d7bc-4c8d-84b2-7e87204eb1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0211d8-d7bc-4c8d-84b2-7e87204eb1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3369f12-ba63-4d10-b00a-50853fcbf563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:54 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Volume ce045958-1079-41af-a91f-5fce5aa119f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce045958-1079-41af-a91f-5fce5aa119f8', 'volume_size': 1} Sep 07 11:10:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:56 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" returned: 0 in 5.573s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:56 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:10:56 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Converted 1024.00 MB image at 183.69 MB/s Sep 07 11:10:56 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 is being set with open permissions: ugo+rw Sep 07 11:10:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:57 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 Sep 07 11:10:57 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:57 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" returned: 0 in 0.250s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" released by "_copy_volume_from_snapshot" :: held 6.831s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=285,cinder:SELECT=216,cinder:DELETE=29,cinder:INSERT=80 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-61234efc-f33d-4b5d-9750-f08b8de20cfc-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" released by "_create_volume_from_snapshot" :: held 6.929s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.962s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.749s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot 7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 of volume cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe344a23-092e-4d53-b848-ba29fc82a697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571', 'volume_size': 1, 'snapshot_id': '61234efc-f33d-4b5d-9750-f08b8de20cfc'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8381284e-cbbc-4407-a34e-df3127ab2c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d109565e-290d-4718-b192-885e7dffb795]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:57 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Volume volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 (d6c4b858-6c31-4f5d-9bec-8f5fe4b78571): created successfully Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8381284e-cbbc-4407-a34e-df3127ab2c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Flow 'volume_create_manager' (3b1a37c3-dbb2-42c0-8151-dc2cf9430774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:10:57 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5aabbc8d-9c82-4527-b8ff-2bc3e1760bab tempest-VolumeDependencyTests-532566652 None] Created volume successfully. Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=205,cinder:UPDATE=283,cinder:INSERT=73,cinder:DELETE=23 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:10:57 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 Sep 07 11:10:57 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:57 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" returned: 0 in 0.387s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:57 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 1G Sep 07 11:10:57 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-61234efc-f33d-4b5d-9750-f08b8de20cfc-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Lock "cinder-61234efc-f33d-4b5d-9750-f08b8de20cfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-quobyte-b5044623-7a2c-42dc-8cdf-4facd1f8b446" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-b5044623-7a2c-42dc-8cdf-4facd1f8b446" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-quobyte-61234efc-f33d-4b5d-9750-f08b8de20cfc" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-61234efc-f33d-4b5d-9750-f08b8de20cfc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Deleting offline snapshot 61234efc-f33d-4b5d-9750-f08b8de20cfc of volume b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] snapshot_file for this snap is: volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5083c614-f695-4063-9a60-7ba203fdb55c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:58 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc Sep 07 11:10:58 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:58 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 1G" returned: 0 in 0.509s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:58 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 Sep 07 11:10:58 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:58 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc" returned: 0 in 0.416s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e02e21-0e6a-4994-8982-7aa2140dbd16]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:58 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 Sep 07 11:10:58 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:58 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" returned: 0 in 0.324s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:58 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 is being set with open permissions: ugo+rw Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:58 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 Sep 07 11:10:58 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:58 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" returned: 0 in 0.255s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:58 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.info Sep 07 11:10:58 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:59 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446" returned: 0 in 0.620s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:59 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc Sep 07 11:10:59 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:59 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.info" returned: 0 in 0.276s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:59 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.info is being set with open permissions: ugo+rw Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:59 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.info Sep 07 11:10:59 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:59 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.info" returned: 0 in 0.317s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:59 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.338s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce045958-1079-41af-a91f-5fce5aa119f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ea932af9c41049c989e38ee4b368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:10:54Z,use_quota=True,user_id='7ea2e1a798f94adebae655d11f5a91b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Creating volume ce045958-1079-41af-a91f-5fce5aa119f8 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:10:59 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:10:59 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 1073741824 Sep 07 11:10:59 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:59 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc Sep 07 11:10:59 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:10:59 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-aaff6db0-8601-4b0a-8e74-02a5358efb82 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:10:59 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446.61234efc-f33d-4b5d-9750-f08b8de20cfc" returned: 0 in 0.302s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-61234efc-f33d-4b5d-9750-f08b8de20cfc" released by "_delete_snapshot" :: held 1.933s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-b5044623-7a2c-42dc-8cdf-4facd1f8b446" released by "delete_snapshot" :: held 1.963s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:10:59 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Created reservations ['7c20d4a3-e1b7-46fa-a453-85665d71433c', 'd063bd89-9361-4740-8dbe-4b8774a332c2', '4455a678-c5a8-46de-b377-065103cb9ab1', 'f746e1a8-cf92-4de9-b0f7-48d6b9901edf'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:00 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Delete snapshot completed successfully. Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 1073741824" returned: 0 in 0.524s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5e01053d-4310-4a3f-919b-e7386a0a179c tempest-VolumeDependencyTests-532566652 None] Lock "cinder-61234efc-f33d-4b5d-9750-f08b8de20cfc-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:00 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 Sep 07 11:11:00 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-b5044623-7a2c-42dc-8cdf-4facd1f8b446-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Lock "cinder-b5044623-7a2c-42dc-8cdf-4facd1f8b446-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-7bc91cd9-336a-43e3-9a13-4bfc488cf2e4-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7bc91cd9-336a-43e3-9a13-4bfc488cf2e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-quobyte-b5044623-7a2c-42dc-8cdf-4facd1f8b446" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot 7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 of volume cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-b5044623-7a2c-42dc-8cdf-4facd1f8b446" acquired by "delete_volume" :: waited 0.052s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf450a-e761-43be-9c45-7049c4404a9f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e882d6-021b-4380-9dd5-141be44d8702]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:00 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8" returned: 0 in 0.393s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3369f12-ba63-4d10-b00a-50853fcbf563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce045958-1079-41af-a91f-5fce5aa119f8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:00 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cacdcb7-45ce-4254-9a4d-a56d60af8b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:00 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:00 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Volume volume-ce045958-1079-41af-a91f-5fce5aa119f8 (ce045958-1079-41af-a91f-5fce5aa119f8): created successfully Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cacdcb7-45ce-4254-9a4d-a56d60af8b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Flow 'volume_create_manager' (85003eac-6ee6-45f8-b4a2-6dcc8068fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0bbc66ef-b124-4f99-b064-cadcd8be0242 tempest-CinderUnicodeTest-1891632580 None] Created volume successfully. Sep 07 11:11:00 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 Sep 07 11:11:00 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:00 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" returned: 0 in 0.420s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e4ed2c-f17a-4f72-a2a7-672bf4db2fc0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:00 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446" returned: 0 in 0.449s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:00 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446 Sep 07 11:11:00 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:00 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 Sep 07 11:11:00 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:01 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-b5044623-7a2c-42dc-8cdf-4facd1f8b446" returned: 0 in 0.352s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-b5044623-7a2c-42dc-8cdf-4facd1f8b446" released by "delete_volume" :: held 0.875s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:01 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" returned: 0 in 0.459s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Created reservations ['6102d04e-98e6-41c3-b0b7-916507cb8794', 'a0bbdcda-ae73-4bfd-be90-b584f42ad832', 'b4e29d3d-34c9-424f-923b-1a2e2cb08fb7', '0815c6e8-f71d-4270-8249-dc8f82cc5f2a'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:01 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 Sep 07 11:11:01 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:01 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:01 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:01 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.462s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:01 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" returned: 0 in 0.603s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:01 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Deleted volume successfully. Sep 07 11:11:01 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4 Sep 07 11:11:01 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c5e4209f-5547-492b-bdd3-417ae189e47e tempest-VolumeDependencyTests-532566652 None] Lock "cinder-b5044623-7a2c-42dc-8cdf-4facd1f8b446-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:02 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Flow 'volume_create_manager' (cf9e6f2d-4bf8-4173-b2e1-c824ce3a7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d24a9e6-950d-4e50-a173-bfae264a3aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3.7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" returned: 0 in 0.347s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d24a9e6-950d-4e50-a173-bfae264a3aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1567065291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2351eb-7d16-4ede-9d85-ee0aa3effce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ea932af9c41049c989e38ee4b368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:02Z,use_quota=True,user_id='7ea2e1a798f94adebae655d11f5a91b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f44d01e-4263-456d-8756-29c58eb2f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f44d01e-4263-456d-8756-29c58eb2f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a868b7d0-3687-4bea-8081-565e380869c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a868b7d0-3687-4bea-8081-565e380869c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed2351eb-7d16-4ede-9d85-ee0aa3effce8', 'volume_name': 'volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a98e66-6779-4829-a4b1-d16660f2b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a98e66-6779-4829-a4b1-d16660f2b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de4eb92-62e3-4138-813c-af9bb89ff070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Volume ed2351eb-7d16-4ede-9d85-ee0aa3effce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8', 'volume_size': 1} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1567065291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2351eb-7d16-4ede-9d85-ee0aa3effce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ea932af9c41049c989e38ee4b368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:02Z,use_quota=True,user_id='7ea2e1a798f94adebae655d11f5a91b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Creating volume ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:02 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7bc91cd9-336a-43e3-9a13-4bfc488cf2e4" released by "_delete_snapshot" :: held 2.038s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" released by "delete_snapshot" :: held 2.086s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:02 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 1073741824 Sep 07 11:11:02 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Created reservations ['526fe35b-ae46-4612-8841-03b0fca8f3ef', 'dfbd494d-c974-48bb-b762-31b68201488e', 'a33a3738-903e-4a5e-8708-09e76df29154', '17df57ce-c49f-4dcd-8873-686b8260af72'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Lock "cinder-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Acquiring lock "cinder-quobyte-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-e6911452-d95f-4a1a-83f5-d59beb812025 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7bc91cd9-336a-43e3-9a13-4bfc488cf2e4-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" acquired by "delete_volume" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eea4ccb-10b5-4ac0-8e00-17c8c12b7b00]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:02 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 Sep 07 11:11:02 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:02 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 1073741824" returned: 0 in 0.556s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:02 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 Sep 07 11:11:02 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:03 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" returned: 0 in 0.442s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:03 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571 Sep 07 11:11:03 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:03 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" returned: 0 in 0.293s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de4eb92-62e3-4138-813c-af9bb89ff070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1eaef6-1db8-4ed6-9065-5e2a7c5a1ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Volume volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 (ed2351eb-7d16-4ede-9d85-ee0aa3effce8): created successfully Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1eaef6-1db8-4ed6-9065-5e2a7c5a1ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Flow 'volume_create_manager' (cf9e6f2d-4bf8-4173-b2e1-c824ce3a7059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-8c340ef5-7eb1-4575-bf4c-4d8594e1dc26 tempest-CinderUnicodeTest-1891632580 None] Created volume successfully. Sep 07 11:11:03 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" returned: 0 in 0.295s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Lock "cinder-quobyte-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571" released by "delete_volume" :: held 0.789s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Lock "cinder-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Created reservations ['9e08ed36-7548-49e3-9812-1d15b131f448', '5a5c59f9-ad8d-4070-9a96-461b39ab8946', '4a061a4b-3612-4281-93a5-253ad113a19b', '6f25f75b-ac55-4609-84fe-8fc712cb89a8'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" acquired by "delete_volume" :: waited 0.030s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef98079-9a2f-4db4-9c65-23b19af3b476]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:03 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:03 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:03 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 Sep 07 11:11:03 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:03 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Deleted volume successfully. Sep 07 11:11:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16025711-1596-4450-9b04-5c2ffad1d1bf tempest-VolumeDependencyTests-532566652 None] Lock "cinder-d6c4b858-6c31-4f5d-9bec-8f5fe4b78571-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:04 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" returned: 0 in 0.491s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:04 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3 Sep 07 11:11:04 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:04 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" returned: 0 in 0.295s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3" released by "delete_volume" :: held 0.866s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Created reservations ['ceeb283f-3ee9-4a29-b242-87d9e47ab1ab', 'aa98330d-265d-46a9-83a3-437d70d1980a', '3a488479-5232-4765-be21-5f18a0446818', '771c86ee-85f4-4944-8f50-7b384c01b174'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:04 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:04 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Creating offline snapshot b759b39f-c08c-4094-a737-2668266bc6c2 of volume ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05b699f-23ba-4fe2-88a4-3052912ce006]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:05 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:05 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.470s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:05 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0a1159c2-d248-4a59-b37f-dca8ee9018df tempest-ProjectMemberTests-652306273 None] Lock "cinder-cf8c47ab-0dfd-4fc6-ba84-43d046120dc3-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:05 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" returned: 0 in 0.458s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:05 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 1G Sep 07 11:11:05 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (2b2bd5ae-003c-4e94-81d1-904213223234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577aea85-b118-467a-976f-f0f237142e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577aea85-b118-467a-976f-f0f237142e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092841097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f801a5cc-cd78-4658-af5a-291c7ba154de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:06Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98500065-1dd9-4b9d-b058-36d31b5419b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98500065-1dd9-4b9d-b058-36d31b5419b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79694709-1dcd-4c67-a5ef-9dd59276fc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79694709-1dcd-4c67-a5ef-9dd59276fc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f801a5cc-cd78-4658-af5a-291c7ba154de', 'volume_name': 'volume-f801a5cc-cd78-4658-af5a-291c7ba154de', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcaea78-0efa-44dc-8672-f5689f8333a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcaea78-0efa-44dc-8672-f5689f8333a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb206b1-ed31-419d-9f8c-613dc23bccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Volume f801a5cc-cd78-4658-af5a-291c7ba154de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f801a5cc-cd78-4658-af5a-291c7ba154de', 'volume_size': 1} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:05 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 1G" returned: 0 in 0.593s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:06 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 Sep 07 11:11:06 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:06 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2" returned: 0 in 0.323s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:06 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 is being set with open permissions: ugo+rw Sep 07 11:11:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:06 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 Sep 07 11:11:06 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:06 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2" returned: 0 in 0.298s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:06 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.info Sep 07 11:11:06 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:07 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.info" returned: 0 in 0.355s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:07 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.info is being set with open permissions: ugo+rw Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:07 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.info Sep 07 11:11:07 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:07 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.info" returned: 0 in 0.280s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092841097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f801a5cc-cd78-4658-af5a-291c7ba154de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:06Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Creating volume f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:07 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:07 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de 1073741824 Sep 07 11:11:07 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9870459a-c527-4c21-8dac-0757e580ff38 tempest-CinderUnicodeTest-1891632580 None] Create snapshot completed successfully Sep 07 11:11:07 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de 1073741824" returned: 0 in 0.490s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:07 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de Sep 07 11:11:07 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "cinder-b759b39f-c08c-4094-a737-2668266bc6c2-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-b759b39f-c08c-4094-a737-2668266bc6c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "cinder-quobyte-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "cinder-quobyte-b759b39f-c08c-4094-a737-2668266bc6c2" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-b759b39f-c08c-4094-a737-2668266bc6c2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Deleting offline snapshot b759b39f-c08c-4094-a737-2668266bc6c2 of volume ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] snapshot_file for this snap is: volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ddefad-b636-4621-a2f7-e34486b23d15]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:08 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de" returned: 0 in 0.311s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb206b1-ed31-419d-9f8c-613dc23bccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f801a5cc-cd78-4658-af5a-291c7ba154de', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d920bd47-90db-48eb-a85e-153505bacf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:08 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Volume volume-f801a5cc-cd78-4658-af5a-291c7ba154de (f801a5cc-cd78-4658-af5a-291c7ba154de): created successfully Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d920bd47-90db-48eb-a85e-153505bacf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (2b2bd5ae-003c-4e94-81d1-904213223234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:08 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5bdd6564-f6ee-4eb4-9731-1f37277d34b0 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:11:08 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 Sep 07 11:11:08 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:08 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2" returned: 0 in 0.514s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bfae96-4107-404f-9d44-8d3e455d2b71]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:08 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 Sep 07 11:11:08 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot d3143707-8e4e-45e5-b7ac-2ff481ab8911 of volume f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67114b2-6144-494c-a6e2-76430b4d6da4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:09 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" returned: 0 in 0.488s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:09 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de Sep 07 11:11:09 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:09 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 Sep 07 11:11:09 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:09 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de" returned: 0 in 0.413s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:09 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 1G Sep 07 11:11:09 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:09 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:09 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2 Sep 07 11:11:09 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:09 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8.b759b39f-c08c-4094-a737-2668266bc6c2" returned: 0 in 0.342s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-b759b39f-c08c-4094-a737-2668266bc6c2" released by "_delete_snapshot" :: held 1.892s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" released by "delete_snapshot" :: held 1.919s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:10 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 1G" returned: 0 in 0.532s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f801a5cc-cd78-4658-af5a-291c7ba154de -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:10 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f801a5cc-cd78-4658-af5a-291c7ba154de -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 Sep 07 11:11:10 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Created reservations ['5646032f-2c77-489e-8e24-f0391ca4dd7c', 'ae97f8db-f9ca-4c07-9248-c2993325ec3d', '1a75e5f3-f054-4060-82e8-87e9427f7556', 'e439980a-2d6d-458b-86c5-8aa69ad77d13'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:10 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Delete snapshot completed successfully. Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9660a132-1841-4c88-84dd-b42875dc511b tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-b759b39f-c08c-4094-a737-2668266bc6c2-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:10 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f801a5cc-cd78-4658-af5a-291c7ba154de -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911" returned: 0 in 0.374s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:10 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 is being set with open permissions: ugo+rw Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:10 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 Sep 07 11:11:10 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:10 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:10 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:10 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911" returned: 0 in 0.401s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:10 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.info Sep 07 11:11:10 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:11 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:11:11 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.info" returned: 0 in 0.357s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:11 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.info is being set with open permissions: ugo+rw Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "cinder-ed2351eb-7d16-4ede-9d85-ee0aa3effce8-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:11 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.info Sep 07 11:11:11 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-ed2351eb-7d16-4ede-9d85-ee0aa3effce8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "cinder-quobyte-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33c674c-8028-47dc-a4da-74569c3ec333]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:11 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 Sep 07 11:11:11 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:11 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.info" returned: 0 in 0.356s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:11 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ed2332d3-3be8-4808-84fa-a5b23a0834a9 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:11:11 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" returned: 0 in 0.460s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:11 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8 Sep 07 11:11:11 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:12 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" returned: 0 in 0.300s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-ed2351eb-7d16-4ede-9d85-ee0aa3effce8" released by "delete_volume" :: held 0.835s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-d3143707-8e4e-45e5-b7ac-2ff481ab8911-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Created reservations ['3b9d16ac-0276-40c8-8b8c-4100c3fb7332', '8444f537-a0e5-4949-b443-20a008b5446f', 'ba184053-a1cb-4f45-85f9-82188dc3fea1', '7f3bd1dc-4002-47a4-a0f5-20bd7e897532'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Lock "cinder-d3143707-8e4e-45e5-b7ac-2ff481ab8911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-f801a5cc-cd78-4658-af5a-291c7ba154de" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f801a5cc-cd78-4658-af5a-291c7ba154de" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-d3143707-8e4e-45e5-b7ac-2ff481ab8911" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-d3143707-8e4e-45e5-b7ac-2ff481ab8911" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot d3143707-8e4e-45e5-b7ac-2ff481ab8911 of volume f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fbf0b3-8342-47a9-9085-a692326f3a78]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "cinder-ce045958-1079-41af-a91f-5fce5aa119f8-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-ce045958-1079-41af-a91f-5fce5aa119f8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:12 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 Sep 07 11:11:12 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:12 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:12 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "cinder-quobyte-ce045958-1079-41af-a91f-5fce5aa119f8" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-ce045958-1079-41af-a91f-5fce5aa119f8" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d0ae16-4c52-4cc8-a4fe-2de84d43f788]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:12 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 Sep 07 11:11:12 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:13 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911" returned: 0 in 0.570s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f801a5cc-cd78-4658-af5a-291c7ba154de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:13 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.484s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[829614d3-fbef-44ac-ad37-400f415619ea]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Deleted volume successfully. Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-153b71ba-51c1-4987-b5fe-3e78ba9ac716 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-ed2351eb-7d16-4ede-9d85-ee0aa3effce8-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:13 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8" returned: 0 in 0.514s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:13 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de Sep 07 11:11:13 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:13 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8 Sep 07 11:11:13 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:13 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ce045958-1079-41af-a91f-5fce5aa119f8" returned: 0 in 0.282s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-quobyte-ce045958-1079-41af-a91f-5fce5aa119f8" released by "delete_volume" :: held 0.856s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:13 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de" returned: 0 in 0.459s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:13 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 Sep 07 11:11:13 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Created reservations ['a5bb30ec-7d68-4b43-b414-ebd3b66cc4c0', 'f214ec07-70b9-4624-9b62-44a4e876a6b5', '85e9114d-3eca-4610-aefa-75c291ff18e8', 'ae9bcadf-3528-4add-99d1-decfbf1add2a'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:13 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:13 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:14 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911" returned: 0 in 0.475s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:14 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911 Sep 07 11:11:14 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:14 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Deleted volume successfully. Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-4274c258-2e17-44d3-9ca7-4463f58eb053 tempest-CinderUnicodeTest-1891632580 None] Lock "cinder-ce045958-1079-41af-a91f-5fce5aa119f8-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:14 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de.d3143707-8e4e-45e5-b7ac-2ff481ab8911" returned: 0 in 0.334s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-d3143707-8e4e-45e5-b7ac-2ff481ab8911" released by "_delete_snapshot" :: held 2.023s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f801a5cc-cd78-4658-af5a-291c7ba154de" released by "delete_snapshot" :: held 2.078s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Created reservations ['a0bb5cae-1219-468d-b080-8e8bf1a35768', '1eee7d23-00e3-42ce-b211-8fa59852caa7', '1c80397f-252f-4e22-ab0b-13bfb1e5f389', '2f658546-c245-41f0-a424-67bb759ab7db'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:14 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:11:14 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ef2d77bd-b870-49c8-8b6d-23eac1fd695e tempest-ProjectMemberTests-652306273 None] Lock "cinder-d3143707-8e4e-45e5-b7ac-2ff481ab8911-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-f801a5cc-cd78-4658-af5a-291c7ba154de-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Lock "cinder-f801a5cc-cd78-4658-af5a-291c7ba154de-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-f801a5cc-cd78-4658-af5a-291c7ba154de" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f801a5cc-cd78-4658-af5a-291c7ba154de" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd18d27f-ad91-49a4-b6ed-d19ea1c4df89]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:15 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de Sep 07 11:11:15 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:16 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de" returned: 0 in 0.452s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:16 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de Sep 07 11:11:16 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:16 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f801a5cc-cd78-4658-af5a-291c7ba154de" returned: 0 in 0.318s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f801a5cc-cd78-4658-af5a-291c7ba154de" released by "delete_volume" :: held 0.854s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Created reservations ['13849ed5-330d-447e-880c-f81cb8f5be5a', '51de7e27-9f87-4da5-ae2a-944141bcc04d', '787f8a9c-64a0-4088-b911-841c77d37ec3', 'ca3154b4-8213-47af-9a44-09f6d365151c'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:16 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:16 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:17 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.357s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b8517736-adbf-496d-9518-7cf105ee634a tempest-ProjectMemberTests-652306273 None] Lock "cinder-f801a5cc-cd78-4658-af5a-291c7ba154de-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (8ea7c85e-cd57-4913-a9f8-63fafae6bd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062b64f7-9b3b-49b0-a5b3-82cdf43d7865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062b64f7-9b3b-49b0-a5b3-82cdf43d7865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1194796614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af324c35-c57a-4c77-8a18-7243d7f33538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:18Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e325536-bb62-469e-8dbb-a65ce1851e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e325536-bb62-469e-8dbb-a65ce1851e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd46331-5a97-40dc-9137-cac5eb75c47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd46331-5a97-40dc-9137-cac5eb75c47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af324c35-c57a-4c77-8a18-7243d7f33538', 'volume_name': 'volume-af324c35-c57a-4c77-8a18-7243d7f33538', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c6e47d-cb53-4060-a568-baeb4a2c9744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c6e47d-cb53-4060-a568-baeb4a2c9744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4982e169-07ae-4357-b469-ff84af2b8fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:17 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Volume af324c35-c57a-4c77-8a18-7243d7f33538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af324c35-c57a-4c77-8a18-7243d7f33538', 'volume_size': 1} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1194796614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af324c35-c57a-4c77-8a18-7243d7f33538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:18Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Creating volume af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:17 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:17 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 1073741824 Sep 07 11:11:17 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Flow 'volume_create_manager' (f36c140b-a800-40fb-b275-65385d6b226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8cbcda-7b41-4939-b7c6-2eea7ea75dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8cbcda-7b41-4939-b7c6-2eea7ea75dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1246424483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eadda40-b8b9-4283-90fa-45df0eade32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50822ba3d5b043e7a9f0706df83ee963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:18Z,use_quota=True,user_id='b28e854e49be4d4cbcec8efe7672bc1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7da9bb-4f83-4eea-a011-0ba73ee825d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7da9bb-4f83-4eea-a011-0ba73ee825d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cc802e-31f4-4e0f-88c7-5b2fb1549eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cc802e-31f4-4e0f-88c7-5b2fb1549eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eadda40-b8b9-4283-90fa-45df0eade32d', 'volume_name': 'volume-1eadda40-b8b9-4283-90fa-45df0eade32d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3204cb29-a83d-4755-b48e-30b2fd7eeb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3204cb29-a83d-4755-b48e-30b2fd7eeb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83a9102-7a51-4387-8445-f86324482820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:18 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Volume 1eadda40-b8b9-4283-90fa-45df0eade32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eadda40-b8b9-4283-90fa-45df0eade32d', 'volume_size': 1} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:18 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 1073741824" returned: 0 in 0.538s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:18 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 Sep 07 11:11:18 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:18 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538" returned: 0 in 0.258s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1246424483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eadda40-b8b9-4283-90fa-45df0eade32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50822ba3d5b043e7a9f0706df83ee963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:18Z,use_quota=True,user_id='b28e854e49be4d4cbcec8efe7672bc1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Creating volume 1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:18 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:18 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d 1073741824 Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4982e169-07ae-4357-b469-ff84af2b8fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af324c35-c57a-4c77-8a18-7243d7f33538', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:18 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b49a782-3aca-4f02-a263-b442c245be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:18 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Volume volume-af324c35-c57a-4c77-8a18-7243d7f33538 (af324c35-c57a-4c77-8a18-7243d7f33538): created successfully Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b49a782-3aca-4f02-a263-b442c245be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:18 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (8ea7c85e-cd57-4913-a9f8-63fafae6bd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:18 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7a292f08-f7ac-40e4-b2d4-9c46c70e5a17 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:11:19 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d 1073741824" returned: 0 in 0.582s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:19 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d Sep 07 11:11:19 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-24a2101d-4794-4087-b942-f30764fac247 tempest-ProjectAdminTests-1314393954 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5923080444336, 'free_capacity_gb': 1773.5923080444336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87271) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 11:11:19 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d" returned: 0 in 0.288s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83a9102-7a51-4387-8445-f86324482820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eadda40-b8b9-4283-90fa-45df0eade32d', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e459ab35-9a0d-4a9e-93e0-a3899e4be252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Volume volume-1eadda40-b8b9-4283-90fa-45df0eade32d (1eadda40-b8b9-4283-90fa-45df0eade32d): created successfully Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e459ab35-9a0d-4a9e-93e0-a3899e4be252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Flow 'volume_create_manager' (f36c140b-a800-40fb-b275-65385d6b226b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-eda76758-efdd-49d0-a73b-e5aec5404abf tempest-SnapshotDependencyTests-1962567145 None] Created volume successfully. Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot 6d4b06c4-42c8-4963-babc-3abd91c1095c of volume af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c9e3a-cdbf-4819-b5f3-803553003135]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:20 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 Sep 07 11:11:20 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:20 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538" returned: 0 in 0.422s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:20 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c 1G Sep 07 11:11:20 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:20 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c 1G" returned: 0 in 0.565s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af324c35-c57a-4c77-8a18-7243d7f33538 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:20 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af324c35-c57a-4c77-8a18-7243d7f33538 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c Sep 07 11:11:20 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:21 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af324c35-c57a-4c77-8a18-7243d7f33538 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c" returned: 0 in 0.324s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:21 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c is being set with open permissions: ugo+rw Sep 07 11:11:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:21 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c Sep 07 11:11:21 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:21 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c" returned: 0 in 0.263s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:21 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.info Sep 07 11:11:21 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:21 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.info" returned: 0 in 0.277s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:21 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.info is being set with open permissions: ugo+rw Sep 07 11:11:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:21 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.info Sep 07 11:11:21 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:22 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.info" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.339s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Creating offline snapshot 310858cd-3034-493f-8ea3-a99c4157a858 of volume 1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:22 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1bb7e8d5-b3e5-4ddd-bae5-e1830cf08fc9 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79d3f94-7191-4995-b2f3-79a64dd5a8e9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:22 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d Sep 07 11:11:22 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:22 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d" returned: 0 in 0.406s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:22 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:22 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 1G Sep 07 11:11:22 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-6d4b06c4-42c8-4963-babc-3abd91c1095c-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:23 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 1G" returned: 0 in 0.493s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eadda40-b8b9-4283-90fa-45df0eade32d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Lock "cinder-6d4b06c4-42c8-4963-babc-3abd91c1095c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-af324c35-c57a-4c77-8a18-7243d7f33538" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:23 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eadda40-b8b9-4283-90fa-45df0eade32d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 Sep 07 11:11:23 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-af324c35-c57a-4c77-8a18-7243d7f33538" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-6d4b06c4-42c8-4963-babc-3abd91c1095c" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-6d4b06c4-42c8-4963-babc-3abd91c1095c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot 6d4b06c4-42c8-4963-babc-3abd91c1095c of volume af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab3d31-1941-443d-9c45-5dbf74a13f13]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:23 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c Sep 07 11:11:23 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:23 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eadda40-b8b9-4283-90fa-45df0eade32d -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858" returned: 0 in 0.300s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:23 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 is being set with open permissions: ugo+rw Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:23 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 Sep 07 11:11:23 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:23 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c" returned: 0 in 0.385s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af324c35-c57a-4c77-8a18-7243d7f33538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce167d6b-44b6-46a4-9e6f-edaa0c16f163]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:23 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858" returned: 0 in 0.260s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:23 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.info Sep 07 11:11:23 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:23 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 Sep 07 11:11:23 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (2223eae4-25c9-42b8-85eb-207423e0c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:23 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd77ae21-1730-4636-a51f-2e68816d4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd77ae21-1730-4636-a51f-2e68816d4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018704455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb259461-2a4f-49cc-9b79-f704e6532ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:24Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8b8a81-71ec-49c2-8620-02e34228a96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8b8a81-71ec-49c2-8620-02e34228a96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01982acb-0b5b-4c27-8278-1b800943af8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01982acb-0b5b-4c27-8278-1b800943af8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb259461-2a4f-49cc-9b79-f704e6532ca4', 'volume_name': 'volume-cb259461-2a4f-49cc-9b79-f704e6532ca4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d396dd-bdef-4f51-b71e-77ebc9179e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d396dd-bdef-4f51-b71e-77ebc9179e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58985bae-8c00-4aca-adf1-c00ab17d8cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:24 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Volume cb259461-2a4f-49cc-9b79-f704e6532ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb259461-2a4f-49cc-9b79-f704e6532ca4', 'volume_size': 1} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:24 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.info" returned: 0 in 0.336s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:24 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.info is being set with open permissions: ugo+rw Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:24 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:24 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.info Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538" returned: 0 in 0.456s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:24 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:24 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c Sep 07 11:11:24 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:24 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.info" returned: 0 in 0.269s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018704455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb259461-2a4f-49cc-9b79-f704e6532ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:24Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Creating volume cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:24 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:24 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 1073741824 Sep 07 11:11:24 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:24 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-548f7e39-ad89-4660-9f24-e63187f52ab2 tempest-SnapshotDependencyTests-1962567145 None] Create snapshot completed successfully Sep 07 11:11:24 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c" returned: 0 in 0.410s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:24 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c Sep 07 11:11:24 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:24 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538.6d4b06c4-42c8-4963-babc-3abd91c1095c" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-6d4b06c4-42c8-4963-babc-3abd91c1095c" released by "_delete_snapshot" :: held 1.637s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-af324c35-c57a-4c77-8a18-7243d7f33538" released by "delete_snapshot" :: held 1.666s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:24 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 1073741824" returned: 0 in 0.535s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Created reservations ['79b4b9de-3cc3-46af-8052-d03ac910868f', '5b2ee9a4-f60a-47f4-b8d7-0df952ed6e00', 'f982fc66-7218-4efc-9eed-0683fb7cd392', '7ad411f1-5b75-4ebf-b0bc-e9be5ac3b4c5'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:24 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:24 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 Sep 07 11:11:24 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9915b04c-e355-4f42-b0ea-fbac29474be7 tempest-ProjectMemberTests-652306273 None] Lock "cinder-6d4b06c4-42c8-4963-babc-3abd91c1095c-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:25 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4" returned: 0 in 0.283s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58985bae-8c00-4aca-adf1-c00ab17d8cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb259461-2a4f-49cc-9b79-f704e6532ca4', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db73895a-bac3-4483-9e27-8acc27e8a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Volume volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 (cb259461-2a4f-49cc-9b79-f704e6532ca4): created successfully Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db73895a-bac3-4483-9e27-8acc27e8a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (2223eae4-25c9-42b8-85eb-207423e0c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-af324c35-c57a-4c77-8a18-7243d7f33538-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:25 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-526869a9-e9fa-4eb2-9fb4-5f1a9ed317fa tempest-ProjectReaderTests-1426019831 None] Created volume successfully. Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Lock "cinder-af324c35-c57a-4c77-8a18-7243d7f33538-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-af324c35-c57a-4c77-8a18-7243d7f33538" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-af324c35-c57a-4c77-8a18-7243d7f33538" acquired by "delete_volume" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[1318f67c-6bcd-4a43-b0e0-120f49b80232]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:25 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 Sep 07 11:11:25 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Flow 'volume_create_manager' (14af5e3a-8012-4de4-ba7f-d8c76b334c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c156f369-7c37-48ba-8fec-fb3d0469502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c156f369-7c37-48ba-8fec-fb3d0469502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1d6d91-21f4-4852-b7cd-b437ab479d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50822ba3d5b043e7a9f0706df83ee963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=310858cd-3034-493f-8ea3-a99c4157a858,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:26Z,use_quota=True,user_id='b28e854e49be4d4cbcec8efe7672bc1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31754ba7-8e4b-4edc-87a8-cb2ba05769ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31754ba7-8e4b-4edc-87a8-cb2ba05769ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4625bb5-2149-46c4-bf51-ef1151c47930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4625bb5-2149-46c4-bf51-ef1151c47930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d1d6d91-21f4-4852-b7cd-b437ab479d9e', 'volume_name': 'volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e', 'volume_size': 1, 'snapshot_id': '310858cd-3034-493f-8ea3-a99c4157a858'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afde336-b576-4e42-8047-11b5c6a7b782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afde336-b576-4e42-8047-11b5c6a7b782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff150e6-8d5f-44fd-a65b-f91819722ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:25 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Volume 2d1d6d91-21f4-4852-b7cd-b437ab479d9e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e', 'volume_size': 1, 'snapshot_id': '310858cd-3034-493f-8ea3-a99c4157a858'} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-quobyte-310858cd-3034-493f-8ea3-a99c4157a858-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" by "_create_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-310858cd-3034-493f-8ea3-a99c4157a858-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Creating volume 2d1d6d91-21f4-4852-b7cd-b437ab479d9e from snapshot 310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-quobyte-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" by "_copy_volume_from_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] snapshot: 310858cd-3034-493f-8ea3-a99c4157a858, volume: 2d1d6d91-21f4-4852-b7cd-b437ab479d9e, {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcc1495-8475-4fc7-b976-4dbac6573efd]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:25 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538" returned: 0 in 0.460s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:25 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:25 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538 Sep 07 11:11:25 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:26 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 Sep 07 11:11:26 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:26 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-af324c35-c57a-4c77-8a18-7243d7f33538" returned: 0 in 0.337s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-af324c35-c57a-4c77-8a18-7243d7f33538" released by "delete_volume" :: held 0.881s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Created reservations ['bfc901ea-0460-4c1d-9d88-b0c2321e4475', 'bcd0f7c8-8705-4355-a07d-8770f7b86e45', '9cbaa057-d6c4-4fbf-8446-69513e6af9c0', '349547a0-bec4-4fb9-bfbf-a2eb652f2bef'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:26 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858" returned: 0 in 0.472s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eadda40-b8b9-4283-90fa-45df0eade32d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9308d014-93a0-47cf-8da9-514392683120]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:26 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:26 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:26 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d Sep 07 11:11:26 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:26 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.334s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:26 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-00eea225-2e37-478d-9077-3d92f84dfad1 tempest-ProjectMemberTests-652306273 None] Lock "cinder-af324c35-c57a-4c77-8a18-7243d7f33538-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:26 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d" returned: 0 in 0.548s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Creating direct copy from snapshot {{(pid=87271) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG cinder.utils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Path /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e not found in is_blk_device check {{(pid=87271) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 11:11:26 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:26 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e Sep 07 11:11:26 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (8829b763-9188-4f67-98ba-db0e836afa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97607883-e1af-44d6-8ee8-30f04e706e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97607883-e1af-44d6-8ee8-30f04e706e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725012667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cfda17-5bf8-465b-82ca-759761dcc988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:27Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5f8d61-dc27-4640-bcd8-ba82e167521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5f8d61-dc27-4640-bcd8-ba82e167521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e19d21-047b-4d3a-8e27-fd7ea6cde030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e19d21-047b-4d3a-8e27-fd7ea6cde030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cfda17-5bf8-465b-82ca-759761dcc988', 'volume_name': 'volume-f0cfda17-5bf8-465b-82ca-759761dcc988', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f1f0d7-785f-4542-bf4c-fce02484784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f1f0d7-785f-4542-bf4c-fce02484784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f5b3e1-3754-49d0-a12e-eed315c9e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:27 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Volume f0cfda17-5bf8-465b-82ca-759761dcc988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cfda17-5bf8-465b-82ca-759761dcc988', 'volume_size': 1} Sep 07 11:11:27 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:31 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" returned: 0 in 4.282s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.image.image_utils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Image conversion details: src /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e {{(pid=87271) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 11:11:31 devstack cinder-volume[87271]: INFO cinder.image.image_utils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Converted 1024.00 MB image at 239.05 MB/s Sep 07 11:11:31 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e is being set with open permissions: ugo+rw Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:31 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e Sep 07 11:11:31 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:31 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" returned: 0 in 0.250s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" released by "_copy_volume_from_snapshot" :: held 5.636s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-310858cd-3034-493f-8ea3-a99c4157a858-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" released by "_create_volume_from_snapshot" :: held 5.711s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.730s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.212s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Creating offline snapshot b416c189-62fb-4183-a9a5-88adb83c719d of volume cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff150e6-8d5f-44fd-a65b-f91819722ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e', 'volume_size': 1, 'snapshot_id': '310858cd-3034-493f-8ea3-a99c4157a858'}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab382d2c-ab88-4a40-b086-a90fca13eaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f4896a-f914-42ca-98d4-25c9dfdc11d9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:31 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Volume volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e (2d1d6d91-21f4-4852-b7cd-b437ab479d9e): created successfully Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab382d2c-ab88-4a40-b086-a90fca13eaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Flow 'volume_create_manager' (14af5e3a-8012-4de4-ba7f-d8c76b334c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:31 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-2a0a8757-0a2f-4aed-a533-7944114bf8d7 tempest-SnapshotDependencyTests-1962567145 None] Created volume successfully. Sep 07 11:11:31 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 Sep 07 11:11:31 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:31 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4" returned: 0 in 0.359s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:31 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:31 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d 1G Sep 07 11:11:31 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-310858cd-3034-493f-8ea3-a99c4157a858-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:32 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d 1G" returned: 0 in 0.405s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-310858cd-3034-493f-8ea3-a99c4157a858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-quobyte-1eadda40-b8b9-4283-90fa-45df0eade32d" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:32 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-1eadda40-b8b9-4283-90fa-45df0eade32d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-quobyte-310858cd-3034-493f-8ea3-a99c4157a858" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:32 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-310858cd-3034-493f-8ea3-a99c4157a858" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Deleting offline snapshot 310858cd-3034-493f-8ea3-a99c4157a858 of volume 1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] snapshot_file for this snap is: volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ae4c3-7aab-4fd2-b638-34d54ba71e56]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:32 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 Sep 07 11:11:32 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:32 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d" returned: 0 in 0.306s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:32 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d is being set with open permissions: ugo+rw Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:32 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d Sep 07 11:11:32 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:32 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858" returned: 0 in 0.367s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eadda40-b8b9-4283-90fa-45df0eade32d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fd6c0-2bc0-47d7-8c06-d2da28b6703d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:32 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d" returned: 0 in 0.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:32 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:32 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d Sep 07 11:11:32 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:32 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.info Sep 07 11:11:32 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:33 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.info" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:33 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.info is being set with open permissions: ugo+rw Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:33 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.info Sep 07 11:11:33 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:33 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d" returned: 0 in 0.516s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:33 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 Sep 07 11:11:33 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:33 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.info" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.318s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725012667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cfda17-5bf8-465b-82ca-759761dcc988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:27Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Creating volume f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:33 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:33 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 1073741824 Sep 07 11:11:33 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:33 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-464410bd-798f-481f-a6e0-86d93fd18f21 tempest-ProjectReaderTests-1426019831 None] Create snapshot completed successfully Sep 07 11:11:33 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858" returned: 0 in 0.406s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:33 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858 Sep 07 11:11:33 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:33 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 1073741824" returned: 0 in 0.466s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:33 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:33 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 Sep 07 11:11:33 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:33 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-b416c189-62fb-4183-a9a5-88adb83c719d-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d.310858cd-3034-493f-8ea3-a99c4157a858" returned: 0 in 0.265s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-b416c189-62fb-4183-a9a5-88adb83c719d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-cb259461-2a4f-49cc-9b79-f704e6532ca4" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-310858cd-3034-493f-8ea3-a99c4157a858" released by "_delete_snapshot" :: held 1.677s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-cb259461-2a4f-49cc-9b79-f704e6532ca4" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-b416c189-62fb-4183-a9a5-88adb83c719d" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-1eadda40-b8b9-4283-90fa-45df0eade32d" released by "delete_snapshot" :: held 1.703s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-b416c189-62fb-4183-a9a5-88adb83c719d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Deleting offline snapshot b416c189-62fb-4183-a9a5-88adb83c719d of volume cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] snapshot_file for this snap is: volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[911b8283-dad1-426b-9e74-6582968d5224]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Created reservations ['3a65084f-9daa-4f05-8783-fdc3b9dbe34b', '0e492c81-d07a-4438-aa7a-478ed42301ed', '12bfbbe5-7b18-4822-b1f2-17870f88ae03', '6881f6e2-29c3-4a02-8556-0ebfa282dfd7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:34 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988" returned: 0 in 0.272s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Delete snapshot completed successfully. Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f5b3e1-3754-49d0-a12e-eed315c9e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cfda17-5bf8-465b-82ca-759761dcc988', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:34 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d Sep 07 11:11:34 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1174697a-7c32-4edf-8807-0fdc3edc38f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b2d3e274-00cb-4dfe-a1e6-2f5898ceda7a tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-310858cd-3034-493f-8ea3-a99c4157a858-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:34 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Volume volume-f0cfda17-5bf8-465b-82ca-759761dcc988 (f0cfda17-5bf8-465b-82ca-759761dcc988): created successfully Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1174697a-7c32-4edf-8807-0fdc3edc38f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (8829b763-9188-4f67-98ba-db0e836afa02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:34 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c3e2af90-d35a-4554-a8cd-96d131fea7e4 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-1eadda40-b8b9-4283-90fa-45df0eade32d-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:34 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d" returned: 0 in 0.377s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb259461-2a4f-49cc-9b79-f704e6532ca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-1eadda40-b8b9-4283-90fa-45df0eade32d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb6d0a6-c8b5-4ede-ac7d-07611a9cc538]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-quobyte-1eadda40-b8b9-4283-90fa-45df0eade32d" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-1eadda40-b8b9-4283-90fa-45df0eade32d" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc6384-4756-4023-92cf-4e9051df43e8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:34 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 Sep 07 11:11:34 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:34 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d Sep 07 11:11:34 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot 7b6b9f2c-b502-452f-bf8b-6afb3e24c34e of volume f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1890dfd-b177-4f6f-896e-814957ab7bab]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:34 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4" returned: 0 in 0.403s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:34 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:34 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d Sep 07 11:11:35 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:35 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 Sep 07 11:11:35 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:35 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d" returned: 0 in 0.432s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:35 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d Sep 07 11:11:35 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:35 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988" returned: 0 in 0.373s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:35 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e 1G Sep 07 11:11:35 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:35 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d" returned: 0 in 0.376s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:35 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d Sep 07 11:11:35 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:35 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-1eadda40-b8b9-4283-90fa-45df0eade32d" returned: 0 in 0.266s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-1eadda40-b8b9-4283-90fa-45df0eade32d" released by "delete_volume" :: held 0.764s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Created reservations ['849ee243-d0cb-4f2f-a7f1-6b9793c691f5', '7d5c8525-c5cb-4862-8e99-d1c53e0da784', 'fdf79246-874e-4f5e-8227-ae38f5dac967', 'd9afcb8c-bcf0-455e-a4c7-5b8cb747004e'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:35 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:35 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:35 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4.b416c189-62fb-4183-a9a5-88adb83c719d" returned: 0 in 0.266s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-b416c189-62fb-4183-a9a5-88adb83c719d" released by "_delete_snapshot" :: held 1.560s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-cb259461-2a4f-49cc-9b79-f704e6532ca4" released by "delete_snapshot" :: held 1.592s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-2d1d6d91-21f4-4852-b7cd-b437ab479d9e-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-2d1d6d91-21f4-4852-b7cd-b437ab479d9e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "cinder-quobyte-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Created reservations ['dc8c7967-bdc1-4f76-9db7-833439c0c5e5', '1a19b557-2fbb-4bac-a737-9517d46e0eb1', '95e6407e-18d7-4172-890e-14332361c22a', '8278c1b5-91c1-4d2e-9619-e10edf4790dd'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:35 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" acquired by "delete_volume" :: waited 0.031s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e 1G" returned: 0 in 0.548s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cfda17-5bf8-465b-82ca-759761dcc988 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4641b6ac-c5b0-4630-8e75-9f5789bd1c31]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:35 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:35 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cfda17-5bf8-465b-82ca-759761dcc988 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e Sep 07 11:11:35 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.345s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Deleted volume successfully. Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-16cc660f-ed9d-4b3c-b061-c25a05be3193 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-1eadda40-b8b9-4283-90fa-45df0eade32d-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:35 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Delete snapshot completed successfully. Sep 07 11:11:35 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6bf9b0dc-a2b4-438f-ad02-a347d5fa7e86 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-b416c189-62fb-4183-a9a5-88adb83c719d-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:35 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e Sep 07 11:11:35 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cfda17-5bf8-465b-82ca-759761dcc988 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" returned: 0 in 0.348s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e is being set with open permissions: ugo+rw Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-cb259461-2a4f-49cc-9b79-f704e6532ca4-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:36 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e Sep 07 11:11:36 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-cb259461-2a4f-49cc-9b79-f704e6532ca4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-cb259461-2a4f-49cc-9b79-f704e6532ca4" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:36 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" returned: 0 in 0.441s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-cb259461-2a4f-49cc-9b79-f704e6532ca4" acquired by "delete_volume" :: waited 0.028s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:36 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e Sep 07 11:11:36 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717b4f7-6b6f-469d-bedb-5d46fb9fa75f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:36 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 Sep 07 11:11:36 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" returned: 0 in 0.294s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:36 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.info Sep 07 11:11:36 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" returned: 0 in 0.275s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-quobyte-2d1d6d91-21f4-4852-b7cd-b437ab479d9e" released by "delete_volume" :: held 0.773s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Created reservations ['9e59683e-b293-43d6-97d7-ca405e612ed0', 'b1b93336-57a8-499d-8d7d-4a2ffdd7a09f', '2761fcbd-38c1-4db1-a76a-67073a38386c', 'b23bce60-c740-4fc9-9ebf-3e5a4bebd3ba'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:36 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:36 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4" returned: 0 in 0.446s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:36 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.info" returned: 0 in 0.307s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:36 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.info is being set with open permissions: ugo+rw Sep 07 11:11:36 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:36 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4 Sep 07 11:11:36 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.info Sep 07 11:11:36 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:36 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Deleted volume successfully. Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-646c8b49-686f-455a-8cbb-0c992b8e0979 tempest-SnapshotDependencyTests-1962567145 None] Lock "cinder-2d1d6d91-21f4-4852-b7cd-b437ab479d9e-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:37 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-cb259461-2a4f-49cc-9b79-f704e6532ca4" returned: 0 in 0.308s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:37 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-cb259461-2a4f-49cc-9b79-f704e6532ca4" released by "delete_volume" :: held 0.827s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.info" returned: 0 in 0.320s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5e1b44dc-dfb9-40a1-ad98-f4c104a84ae6 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Created reservations ['62365d3e-645a-4b93-850e-97e4e398238f', '3ff3de19-6c8d-4cd8-ac5b-f159f2cc5c91', '29f3d1d1-f4e0-4a28-b242-4cf51d4b1f97', '4d91b34e-5959-4590-b9c6-3c201e0314a8'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:37 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:37 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:37 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.276s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:37 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Deleted volume successfully. Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0d546f38-9e22-47ac-ac45-de4758a1f2e4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-cb259461-2a4f-49cc-9b79-f704e6532ca4-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (02914eda-0a05-4ee1-8ef4-71b282f7aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07783f2f-9b36-449e-8e86-18c35d18be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07783f2f-9b36-449e-8e86-18c35d18be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104338938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cef91f-5840-48f7-a7a9-e99c66d12018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:38Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968b715c-d942-4f43-ae97-b96b5c7d308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968b715c-d942-4f43-ae97-b96b5c7d308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ec43d6-c057-4df2-8dcd-e3aae5e689f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:37 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ec43d6-c057-4df2-8dcd-e3aae5e689f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cef91f-5840-48f7-a7a9-e99c66d12018', 'volume_name': 'volume-60cef91f-5840-48f7-a7a9-e99c66d12018', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5764c32d-95ee-4d28-88c7-ec010f88b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5764c32d-95ee-4d28-88c7-ec010f88b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87088572-e0f1-48e2-aac8-f2fcbbcfac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Volume 60cef91f-5840-48f7-a7a9-e99c66d12018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cef91f-5840-48f7-a7a9-e99c66d12018', 'volume_size': 1} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104338938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cef91f-5840-48f7-a7a9-e99c66d12018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:38Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Creating volume 60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:38 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:38 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 1073741824 Sep 07 11:11:38 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-7b6b9f2c-b502-452f-bf8b-6afb3e24c34e-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7b6b9f2c-b502-452f-bf8b-6afb3e24c34e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-f0cfda17-5bf8-465b-82ca-759761dcc988" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f0cfda17-5bf8-465b-82ca-759761dcc988" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot 7b6b9f2c-b502-452f-bf8b-6afb3e24c34e of volume f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd7531-5504-446b-856c-8fe4eeb42b70]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:38 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e Sep 07 11:11:38 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:38 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 1073741824" returned: 0 in 0.434s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:38 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 Sep 07 11:11:38 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:38 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" returned: 0 in 0.429s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0cfda17-5bf8-465b-82ca-759761dcc988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[9931e8e4-1295-4cba-bc09-dbffdec831b6]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:38 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 Sep 07 11:11:38 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:38 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018" returned: 0 in 0.282s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87088572-e0f1-48e2-aac8-f2fcbbcfac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cef91f-5840-48f7-a7a9-e99c66d12018', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e35653-b587-41c6-9993-1b9ebbdd353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:38 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Volume volume-60cef91f-5840-48f7-a7a9-e99c66d12018 (60cef91f-5840-48f7-a7a9-e99c66d12018): created successfully Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e35653-b587-41c6-9993-1b9ebbdd353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:38 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (02914eda-0a05-4ee1-8ef4-71b282f7aa11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:38 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-34382b3e-5198-4c95-9da0-9af5f7b5f773 tempest-ProjectReaderTests-1426019831 None] Created volume successfully. Sep 07 11:11:39 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988" returned: 0 in 0.383s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:39 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e Sep 07 11:11:39 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:39 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" returned: 0 in 0.338s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:39 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e Sep 07 11:11:39 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:39 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988.7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7b6b9f2c-b502-452f-bf8b-6afb3e24c34e" released by "_delete_snapshot" :: held 1.505s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f0cfda17-5bf8-465b-82ca-759761dcc988" released by "delete_snapshot" :: held 1.533s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Created reservations ['6a2f112d-29d1-4207-8c67-b6b40ba883c7', '743ab628-9751-4b52-9f6a-355e7b815781', 'be84eded-fe77-479c-b2e2-70e9e61a6ac8', 'a54ed041-3fb0-41ce-8207-0a2fac7838ef'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:39 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:11:39 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-92f4c42c-fd67-4195-9247-984a585eb1c9 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7b6b9f2c-b502-452f-bf8b-6afb3e24c34e-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Creating offline snapshot 06348e86-8bbc-4eee-9e92-29f41254def8 of volume 60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a4b75-72b0-44f8-a45b-91c8ddf67339]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-f0cfda17-5bf8-465b-82ca-759761dcc988-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:40 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 Sep 07 11:11:40 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Lock "cinder-f0cfda17-5bf8-465b-82ca-759761dcc988-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-f0cfda17-5bf8-465b-82ca-759761dcc988" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f0cfda17-5bf8-465b-82ca-759761dcc988" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[131430cf-2c58-4bf5-99ff-edb1eacb385f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:40 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 Sep 07 11:11:40 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:40 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018" returned: 0 in 0.418s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:40 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 1G Sep 07 11:11:40 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:40 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:40 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:40 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988 Sep 07 11:11:40 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:41 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 1G" returned: 0 in 0.479s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60cef91f-5840-48f7-a7a9-e99c66d12018 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:41 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60cef91f-5840-48f7-a7a9-e99c66d12018 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 Sep 07 11:11:41 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:41 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-f0cfda17-5bf8-465b-82ca-759761dcc988" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-f0cfda17-5bf8-465b-82ca-759761dcc988" released by "delete_volume" :: held 0.796s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Created reservations ['92df2acc-e810-4177-ac0b-5879203bb041', '5afcdaf7-5185-43b8-9481-6c0842cb1196', '69846a51-9703-4aae-a54e-8c1dd4ca3f0f', '32696111-e906-4757-8f90-6bee66f6732a'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:41 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:41 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:41 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60cef91f-5840-48f7-a7a9-e99c66d12018 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8" returned: 0 in 0.411s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:41 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 is being set with open permissions: ugo+rw Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:41 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 Sep 07 11:11:41 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:41 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.347s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:41 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-c223f858-3aeb-4efb-b881-532f3f2bce53 tempest-ProjectMemberTests-652306273 None] Lock "cinder-f0cfda17-5bf8-465b-82ca-759761dcc988-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:41 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8" returned: 0 in 0.322s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:41 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:41 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.info Sep 07 11:11:41 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (5bdf49c6-30c9-436f-8dcf-696df80c04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a21fe10-4fde-469f-9189-fc044f5a289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a21fe10-4fde-469f-9189-fc044f5a289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665146966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:42Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e328bbfd-966b-41dd-91eb-1b06a80c1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:42 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e328bbfd-966b-41dd-91eb-1b06a80c1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4415147d-6e47-4a13-be6a-bf651a4f8177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4415147d-6e47-4a13-be6a-bf651a4f8177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c', 'volume_name': 'volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56046c15-e7e9-430d-a0b9-68670fe65cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56046c15-e7e9-430d-a0b9-68670fe65cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069eee7f-3e5f-4207-bbe9-e17fe9c03d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:42 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Volume 7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c', 'volume_size': 1} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.info" returned: 0 in 0.318s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:42 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.info is being set with open permissions: ugo+rw Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:42 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.info Sep 07 11:11:42 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:42 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.info" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665146966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:42Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Creating volume 7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:42 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:42 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c 1073741824 Sep 07 11:11:42 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:42 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-88c85461-f6b5-4c0a-896d-2d4d49e30b3a tempest-ProjectReaderTests-1426019831 None] Create snapshot completed successfully Sep 07 11:11:42 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c 1073741824" returned: 0 in 0.442s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:42 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:42 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c Sep 07 11:11:42 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:43 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069eee7f-3e5f-4207-bbe9-e17fe9c03d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6699b3e4-330e-4441-9df4-ac54a8309eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:43 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Volume volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c (7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c): created successfully Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6699b3e4-330e-4441-9df4-ac54a8309eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (5bdf49c6-30c9-436f-8dcf-696df80c04de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:43 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7812dd09-a2fd-47e2-a11e-323e37978f00 tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-06348e86-8bbc-4eee-9e92-29f41254def8-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-06348e86-8bbc-4eee-9e92-29f41254def8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-60cef91f-5840-48f7-a7a9-e99c66d12018" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-60cef91f-5840-48f7-a7a9-e99c66d12018" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-06348e86-8bbc-4eee-9e92-29f41254def8" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-06348e86-8bbc-4eee-9e92-29f41254def8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Deleting offline snapshot 06348e86-8bbc-4eee-9e92-29f41254def8 of volume 60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] snapshot_file for this snap is: volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090f899-d20d-494a-88f1-4a6458b7054c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:43 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 Sep 07 11:11:43 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:43 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8" returned: 0 in 0.382s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60cef91f-5840-48f7-a7a9-e99c66d12018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b369d950-18fc-4f91-a27b-d97eb404f018]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:43 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:43 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 Sep 07 11:11:43 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:44 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018" returned: 0 in 0.382s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:44 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 Sep 07 11:11:44 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Creating offline snapshot d8e14109-ed35-4b9e-be46-62b5d5502ce1 of volume 7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f6547-2c63-418b-88e7-b040d677d956]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:44 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c Sep 07 11:11:44 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:44 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8" returned: 0 in 0.351s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:44 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8 Sep 07 11:11:44 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:44 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" returned: 0 in 0.399s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:44 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 1G Sep 07 11:11:44 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:44 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018.06348e86-8bbc-4eee-9e92-29f41254def8" returned: 0 in 0.277s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-06348e86-8bbc-4eee-9e92-29f41254def8" released by "_delete_snapshot" :: held 1.496s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-60cef91f-5840-48f7-a7a9-e99c66d12018" released by "delete_snapshot" :: held 1.526s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:44 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Created reservations ['205b5b20-6801-41b3-98b1-974c6b391c48', '60e38df9-5287-4ed9-a577-41f69ff32a37', '150a3f89-5fc2-4c47-9d61-85527eb1cd44', '220d5057-6088-4d27-909d-e417ff896bf7'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:45 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Delete snapshot completed successfully. Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6b004834-b829-4e0a-ac6f-9f7f549a9d01 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-06348e86-8bbc-4eee-9e92-29f41254def8-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:45 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 1G" returned: 0 in 0.493s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:45 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 Sep 07 11:11:45 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-60cef91f-5840-48f7-a7a9-e99c66d12018-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Lock "cinder-60cef91f-5840-48f7-a7a9-e99c66d12018-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-60cef91f-5840-48f7-a7a9-e99c66d12018" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-60cef91f-5840-48f7-a7a9-e99c66d12018" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:45 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1" returned: 0 in 0.392s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:45 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 is being set with open permissions: ugo+rw Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[d570f6a4-7348-4964-8f0a-57b244dba01c]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:45 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 Sep 07 11:11:45 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:45 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 Sep 07 11:11:45 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:45 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1" returned: 0 in 0.291s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:45 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:45 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.info Sep 07 11:11:45 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:46 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018" returned: 0 in 0.461s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:46 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018 Sep 07 11:11:46 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:46 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.info" returned: 0 in 0.285s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:46 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.info is being set with open permissions: ugo+rw Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:46 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.info Sep 07 11:11:46 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:46 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-60cef91f-5840-48f7-a7a9-e99c66d12018" returned: 0 in 0.274s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-60cef91f-5840-48f7-a7a9-e99c66d12018" released by "delete_volume" :: held 0.820s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Created reservations ['6e567d67-856d-47f0-9b46-535ffa60862a', '40a5760d-d801-4999-a80c-42cdcb3209bd', 'b1536e0d-460c-435e-9573-c4b8a4fb1c4a', '0fa5a2d1-35ac-4572-bad8-e470e8598750'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:46 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.info" returned: 0 in 0.275s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4950d290-e609-4c8b-9242-ad50b73f6b45 tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:46 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:46 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:46 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.330s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:46 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Deleted volume successfully. Sep 07 11:11:46 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-f84cf924-1ec5-4989-8d38-5a704fe902ac tempest-ProjectReaderTests-1426019831 None] Lock "cinder-60cef91f-5840-48f7-a7a9-e99c66d12018-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (9e519d06-a2e6-4d89-a702-4e4eee6dc2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953efbe9-f41a-4a03-a5b5-6dd733a9056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953efbe9-f41a-4a03-a5b5-6dd733a9056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700498552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:47Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3f99a8-cf54-49ce-b9ec-f5e8fc55f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3f99a8-cf54-49ce-b9ec-f5e8fc55f319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17603aa0-0e30-4a80-bd8a-af73be025a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17603aa0-0e30-4a80-bd8a-af73be025a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0', 'volume_name': 'volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4095b38-93bd-4065-9e68-52f37ac2092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4095b38-93bd-4065-9e68-52f37ac2092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66246fe-d9b5-4724-9ae7-ad56f714f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:47 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Volume e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0', 'volume_size': 1} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700498552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:47Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Creating volume e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:47 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:47 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 1073741824 Sep 07 11:11:47 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-d8e14109-ed35-4b9e-be46-62b5d5502ce1-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Lock "cinder-d8e14109-ed35-4b9e-be46-62b5d5502ce1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-d8e14109-ed35-4b9e-be46-62b5d5502ce1" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-d8e14109-ed35-4b9e-be46-62b5d5502ce1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot d8e14109-ed35-4b9e-be46-62b5d5502ce1 of volume 7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb2e19-7876-434d-805f-aa215a52a704]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:47 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 Sep 07 11:11:47 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:47 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 1073741824" returned: 0 in 0.514s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:47 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:47 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 Sep 07 11:11:47 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:48 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1" returned: 0 in 0.431s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9da2d2-3e2c-4c9a-8c92-4a0e038aef09]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:48 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" returned: 0 in 0.291s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66246fe-d9b5-4724-9ae7-ad56f714f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9888a83-b555-402b-a59d-0cf571ddd150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:48 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Volume volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 (e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0): created successfully Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9888a83-b555-402b-a59d-0cf571ddd150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (9e519d06-a2e6-4d89-a702-4e4eee6dc2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:48 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-7702ab53-33cd-4007-a0b7-c895f2beaf6c tempest-ProjectReaderTests-1426019831 None] Created volume successfully. Sep 07 11:11:48 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c Sep 07 11:11:48 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:48 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" returned: 0 in 0.391s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:48 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 Sep 07 11:11:48 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:48 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1" returned: 0 in 0.322s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:48 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:48 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1 Sep 07 11:11:48 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:49 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c.d8e14109-ed35-4b9e-be46-62b5d5502ce1" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-d8e14109-ed35-4b9e-be46-62b5d5502ce1" released by "_delete_snapshot" :: held 1.495s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" released by "delete_snapshot" :: held 1.531s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Created reservations ['fca0b3ec-d0cb-4438-b7ca-a8ffff3c4d55', '1e8bbcc0-150d-46dd-a291-7f8377bc552b', '997d2736-b549-4e6c-b019-c6766284f009', '2eafe5d6-2297-46a9-8bb3-937ac435c5a9'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:49 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b5d9f13e-b4c3-45f6-a5c9-8fca952a49dd tempest-ProjectMemberTests-652306273 None] Lock "cinder-d8e14109-ed35-4b9e-be46-62b5d5502ce1-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Creating offline snapshot 2681a79c-5fe8-4073-8209-c54ae3ce02c5 of volume e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[73695674-9e75-49f4-8286-b4fc7ea823e7]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:49 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 Sep 07 11:11:49 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:49 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8440d6d2-8f2c-46f1-a9c3-2490f4e0f042]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" returned: 0 in 0.379s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:49 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:49 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 1G Sep 07 11:11:49 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:49 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c Sep 07 11:11:49 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:50 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:50 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c Sep 07 11:11:50 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:50 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 1G" returned: 0 in 0.386s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:50 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 Sep 07 11:11:50 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:50 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c" released by "delete_volume" :: held 0.670s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Created reservations ['3770ecbe-372a-4134-b0e6-545a892ac189', 'f63b526c-45b5-444f-b798-b862f08550aa', '55c3ba8c-0a56-4550-aee5-673ab650efa1', '42a805b0-b0a8-4322-b0ed-234203484b25'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:50 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5" returned: 0 in 0.289s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:50 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 is being set with open permissions: ugo+rw Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:50 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 Sep 07 11:11:50 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:50 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:50 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:50 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5" returned: 0 in 0.256s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:50 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:50 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.info Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.245s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:50 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:50 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:11:50 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-faab8c97-4821-45b1-8b4f-891d8d226d26 tempest-ProjectMemberTests-652306273 None] Lock "cinder-7fa53f4c-6826-4a8f-994c-8bae3a4ddd2c-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:51 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.info" returned: 0 in 0.261s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:51 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.info is being set with open permissions: ugo+rw Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:51 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.info Sep 07 11:11:51 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:51 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.info" returned: 0 in 0.254s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (f121a426-ebb2-45ea-8c62-6b64e82d6a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df0e365-b737-4188-8fcf-8bb3a331ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df0e365-b737-4188-8fcf-8bb3a331ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739414898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1e730d-6eb9-48a5-a0f5-457e393da0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:51Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f9fed9-333e-48b1-bf3d-597547255c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f9fed9-333e-48b1-bf3d-597547255c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73be51f9-2455-45d8-a288-b37f3dbe95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73be51f9-2455-45d8-a288-b37f3dbe95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1e730d-6eb9-48a5-a0f5-457e393da0b3', 'volume_name': 'volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1ecfdc-6a86-4bb9-88ca-1078f58c4ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1ecfdc-6a86-4bb9-88ca-1078f58c4ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef8aec7-771d-4055-9cb9-e0b748232cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:51 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Volume fc1e730d-6eb9-48a5-a0f5-457e393da0b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3', 'volume_size': 1} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739414898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1e730d-6eb9-48a5-a0f5-457e393da0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22084783157b4118bfc46b1bf42cfd3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:51Z,use_quota=True,user_id='7352dceae02846c4998ee0d3151774de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Creating volume fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:51 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:51 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e613e60f-2bfc-4776-8269-c1b34bdf02f8 tempest-ProjectReaderTests-1426019831 None] Create snapshot completed successfully Sep 07 11:11:51 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 1073741824 Sep 07 11:11:51 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-2681a79c-5fe8-4073-8209-c54ae3ce02c5-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-2681a79c-5fe8-4073-8209-c54ae3ce02c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-2681a79c-5fe8-4073-8209-c54ae3ce02c5" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-2681a79c-5fe8-4073-8209-c54ae3ce02c5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Deleting offline snapshot 2681a79c-5fe8-4073-8209-c54ae3ce02c5 of volume e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] snapshot_file for this snap is: volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2343347-81a2-4a75-be06-e85bf646fad9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:51 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 Sep 07 11:11:51 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:51 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 1073741824" returned: 0 in 0.428s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:51 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 Sep 07 11:11:51 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:51 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:51 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ed0c5f-65fd-433a-a866-3f77c76769f4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:52 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" returned: 0 in 0.242s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef8aec7-771d-4055-9cb9-e0b748232cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:52 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 Sep 07 11:11:52 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b2de0e-2944-4539-b5b8-9a979ef1b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:52 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Volume volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 (fc1e730d-6eb9-48a5-a0f5-457e393da0b3): created successfully Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b2de0e-2944-4539-b5b8-9a979ef1b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Flow 'volume_create_manager' (f121a426-ebb2-45ea-8c62-6b64e82d6a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:52 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-c00d7a65-5865-4286-b316-f7255bd191fb tempest-ProjectMemberTests-652306273 None] Created volume successfully. Sep 07 11:11:52 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" returned: 0 in 0.361s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:52 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 Sep 07 11:11:52 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Creating offline snapshot 2d0858d7-2d49-4f00-a3ae-4f753190e006 of volume fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2484aa-f1cb-43b7-bd7f-bf74f64ed9da]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:52 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 Sep 07 11:11:52 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:52 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5" returned: 0 in 0.358s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:52 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5 Sep 07 11:11:52 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:52 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" returned: 0 in 0.362s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:52 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 1G Sep 07 11:11:52 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:52 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:52 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0.2681a79c-5fe8-4073-8209-c54ae3ce02c5" returned: 0 in 0.246s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-2681a79c-5fe8-4073-8209-c54ae3ce02c5" released by "_delete_snapshot" :: held 1.418s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" released by "delete_snapshot" :: held 1.446s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Created reservations ['c9eaade4-b617-47ec-9e60-de010e3cf769', '4f06309f-9e47-46b6-b5de-5b438532f61d', '8fe465f7-1107-476a-9740-f83a06229c44', '883dc5f7-7f36-45de-9efd-8c294d4ebae1'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:53 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Delete snapshot completed successfully. Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-27072b5a-a3dc-423a-bf58-34e747263963 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-2681a79c-5fe8-4073-8209-c54ae3ce02c5-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:53 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 1G" returned: 0 in 0.393s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:53 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 Sep 07 11:11:53 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:53 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006" returned: 0 in 0.278s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:53 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 is being set with open permissions: ugo+rw Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:53 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 Sep 07 11:11:53 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:53 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006" returned: 0 in 0.273s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa34afa2-54e6-4ef6-985a-9b7028f056c0]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:53 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:53 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.info Sep 07 11:11:53 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:53 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 Sep 07 11:11:53 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:54 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.info" returned: 0 in 0.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:54 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.info is being set with open permissions: ugo+rw Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:54 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.info Sep 07 11:11:54 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:54 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" returned: 0 in 0.367s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:54 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0 Sep 07 11:11:54 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:54 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.info" returned: 0 in 0.246s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:54 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-342d21c1-c3ad-4c46-91e0-3b1fad64c1ba tempest-ProjectMemberTests-652306273 None] Create snapshot completed successfully Sep 07 11:11:54 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" returned: 0 in 0.259s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0" released by "delete_volume" :: held 0.685s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Created reservations ['8b6b758f-df7e-4584-b782-5321d0f2946c', '6b960c40-db0d-4e9b-a1e4-799c2a4dba4e', '667c9388-55bd-465d-a01c-08b2674a7f5a', '8752e324-a696-4273-b1cd-2adcee0494f8'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:54 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:54 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-2d0858d7-2d49-4f00-a3ae-4f753190e006-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Lock "cinder-2d0858d7-2d49-4f00-a3ae-4f753190e006-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-2d0858d7-2d49-4f00-a3ae-4f753190e006" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-2d0858d7-2d49-4f00-a3ae-4f753190e006" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Deleting offline snapshot 2d0858d7-2d49-4f00-a3ae-4f753190e006 of volume fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] snapshot_file for this snap is: volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[86207ede-8ec3-4423-b1dd-87016c0b253f]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:54 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 Sep 07 11:11:54 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:54 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.274s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:54 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Deleted volume successfully. Sep 07 11:11:54 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-87fb7213-6890-4668-8cdd-b4d930bec4c4 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-e5493f4a-dcf6-4763-b5a4-10f1ade2d7f0-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:55 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006" returned: 0 in 0.387s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab143172-9fed-4063-878c-7ce903aeeae4]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:55 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 Sep 07 11:11:55 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (192b5b8b-4e04-4d75-a5e2-cf9e163f5e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124df42c-95df-4688-b656-0ef7111ff726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124df42c-95df-4688-b656-0ef7111ff726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689882699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7941d99c-a1ef-4dce-923a-13417fa24a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:55Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdc701b-b16e-4fbd-8739-08c8117ae1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdc701b-b16e-4fbd-8739-08c8117ae1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45540c32-1299-43a8-9fa7-7b31559dcc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45540c32-1299-43a8-9fa7-7b31559dcc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7941d99c-a1ef-4dce-923a-13417fa24a83', 'volume_name': 'volume-7941d99c-a1ef-4dce-923a-13417fa24a83', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3326b794-4a9b-40f4-b101-23d849e8b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3326b794-4a9b-40f4-b101-23d849e8b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5765502c-349c-4725-8b5c-33678606f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:55 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Volume 7941d99c-a1ef-4dce-923a-13417fa24a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7941d99c-a1ef-4dce-923a-13417fa24a83', 'volume_size': 1} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689882699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7941d99c-a1ef-4dce-923a-13417fa24a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:11:55Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Creating volume 7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:11:55 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:55 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 1073741824 Sep 07 11:11:55 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:55 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" returned: 0 in 0.371s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:55 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 Sep 07 11:11:55 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:55 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 1073741824" returned: 0 in 0.443s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:55 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006" returned: 0 in 0.336s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:55 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006 Sep 07 11:11:55 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:55 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:55 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 Sep 07 11:11:55 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:56 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3.2d0858d7-2d49-4f00-a3ae-4f753190e006" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-2d0858d7-2d49-4f00-a3ae-4f753190e006" released by "_delete_snapshot" :: held 1.436s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:56 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" released by "delete_snapshot" :: held 1.461s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5765502c-349c-4725-8b5c-33678606f009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7941d99c-a1ef-4dce-923a-13417fa24a83', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1313d929-794a-4731-8e91-2abe9d115112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:11:56 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Volume volume-7941d99c-a1ef-4dce-923a-13417fa24a83 (7941d99c-a1ef-4dce-923a-13417fa24a83): created successfully Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1313d929-794a-4731-8e91-2abe9d115112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (192b5b8b-4e04-4d75-a5e2-cf9e163f5e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:11:56 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-da27d97c-95a0-4815-81f8-4de7ddae66bf tempest-ProjectReaderTests-1426019831 None] Created volume successfully. Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Created reservations ['9dc4f328-fe70-476a-b4b0-4c40dbbb21ea', 'e52675d2-ea8a-4d7c-8778-3dfb127b20b0', 'e7cf3f91-c191-4480-936b-19cba30b4596', '239ce8bd-9c05-4748-986f-4220221c7503'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:56 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Delete snapshot completed successfully. Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-b0827bb7-069c-4fbc-a54a-3fcdd44951d2 tempest-ProjectMemberTests-652306273 None] Lock "cinder-2d0858d7-2d49-4f00-a3ae-4f753190e006-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Creating offline snapshot 914bb7f6-76f5-467e-8dcb-194b42761f02 of volume 7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c36609-c087-4cea-aa08-fd85e56dc726]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:56 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 Sep 07 11:11:56 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-fc1e730d-6eb9-48a5-a0f5-457e393da0b3-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Lock "cinder-fc1e730d-6eb9-48a5-a0f5-457e393da0b3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:56 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Acquiring lock "cinder-quobyte-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:56 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 1G Sep 07 11:11:56 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:56 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84ec3f-0640-4e4b-a209-198b6c0b7752]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:57 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 Sep 07 11:11:57 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:57 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 1G" returned: 0 in 0.396s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7941d99c-a1ef-4dce-923a-13417fa24a83 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:57 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7941d99c-a1ef-4dce-923a-13417fa24a83 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 Sep 07 11:11:57 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:57 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" returned: 0 in 0.380s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:57 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3 Sep 07 11:11:57 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:57 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7941d99c-a1ef-4dce-923a-13417fa24a83 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02" returned: 0 in 0.298s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:57 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 is being set with open permissions: ugo+rw Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:57 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" returned: 0 in 0.255s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:57 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 Sep 07 11:11:57 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Lock "cinder-quobyte-fc1e730d-6eb9-48a5-a0f5-457e393da0b3" released by "delete_volume" :: held 0.695s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=182,cinder:UPDATE=233,cinder:INSERT=65,cinder:DELETE=20 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=191,cinder:UPDATE=236,cinder:INSERT=63,cinder:DELETE=18 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Created reservations ['fbb217cf-d913-423a-b3fe-c261ab03620f', '0a3d09c2-d5a3-4b19-b178-8e18f848b0fc', 'b76dab1d-0dd7-48ea-b43b-781e6b13fd94', 'b8c03502-6108-4965-afca-f0d638491be9'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:57 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:11:57 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:57 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:57 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:57 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.info Sep 07 11:11:57 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:58 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.272s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:11:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Deleted volume successfully. Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-33f9381d-0dfb-4d65-908a-609c3f9a3fe8 tempest-ProjectMemberTests-652306273 None] Lock "cinder-fc1e730d-6eb9-48a5-a0f5-457e393da0b3-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:11:58 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.info" returned: 0 in 0.273s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:58 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.info is being set with open permissions: ugo+rw Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:58 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.info Sep 07 11:11:58 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:58 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.info" returned: 0 in 0.266s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:11:58 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9fddaddc-68e8-413a-afcd-66e83879d0f2 tempest-ProjectReaderTests-1426019831 None] Create snapshot completed successfully Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-914bb7f6-76f5-467e-8dcb-194b42761f02-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-914bb7f6-76f5-467e-8dcb-194b42761f02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-7941d99c-a1ef-4dce-923a-13417fa24a83" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-7941d99c-a1ef-4dce-923a-13417fa24a83" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-914bb7f6-76f5-467e-8dcb-194b42761f02" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-914bb7f6-76f5-467e-8dcb-194b42761f02" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Deleting offline snapshot 914bb7f6-76f5-467e-8dcb-194b42761f02 of volume 7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] snapshot_file for this snap is: volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[411db435-83be-4540-9160-714901149ebd]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:58 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:58 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 Sep 07 11:11:58 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:59 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02" returned: 0 in 0.388s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7941d99c-a1ef-4dce-923a-13417fa24a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[041db4b0-3ac6-4e8d-9287-18ac9f22f7c1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:59 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 Sep 07 11:11:59 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:59 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83" returned: 0 in 0.375s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:59 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 Sep 07 11:11:59 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:11:59 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02" returned: 0 in 0.365s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:11:59 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:11:59 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02 Sep 07 11:11:59 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:00 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83.914bb7f6-76f5-467e-8dcb-194b42761f02" returned: 0 in 0.247s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-914bb7f6-76f5-467e-8dcb-194b42761f02" released by "_delete_snapshot" :: held 1.469s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-7941d99c-a1ef-4dce-923a-13417fa24a83" released by "delete_snapshot" :: held 1.492s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Created reservations ['7ec3fee5-23c8-4317-85c0-7cefa4f4ef3d', '57222123-85a1-488e-bc1d-d00f11ca82a6', '61a69714-096a-4d98-a43a-400cca0a040c', 'fb2b4232-f3ba-49b7-916f-0ccc0fa34576'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:00 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Delete snapshot completed successfully. Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-6eff6f77-b462-447b-b1b2-2a89c12efa42 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-914bb7f6-76f5-467e-8dcb-194b42761f02-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-7941d99c-a1ef-4dce-923a-13417fa24a83-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Lock "cinder-7941d99c-a1ef-4dce-923a-13417fa24a83-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-7941d99c-a1ef-4dce-923a-13417fa24a83" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-7941d99c-a1ef-4dce-923a-13417fa24a83" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b02cc6c-36ab-4063-a414-d937432bbd00]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:00 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:01 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 Sep 07 11:12:01 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:01 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83" returned: 0 in 0.359s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:01 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83 Sep 07 11:12:01 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:01 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7941d99c-a1ef-4dce-923a-13417fa24a83" returned: 0 in 0.258s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-7941d99c-a1ef-4dce-923a-13417fa24a83" released by "delete_volume" :: held 0.687s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Created reservations ['2cb9c508-f1d2-4f92-80e4-72ea787f75e8', 'e310fb67-7d3e-4522-a847-f8fd13fa2a5e', '98693083-6710-4bb2-bf92-0e06bbe51c22', 'f99dc2b7-7001-4d52-9c13-dc038a30286d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:01 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:01 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Flow 'volume_create_manager' (8d2a0943-375d-4630-9f94-4fdcf97482d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9c5f55-1f2a-4c3c-8ffc-7aad12225271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9c5f55-1f2a-4c3c-8ffc-7aad12225271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871700896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3891f966-c5ea-46fb-b9d1-e90cd5680f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe1346f747343289be91ee2239bb3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:02Z,use_quota=True,user_id='30bb1159711e464b8189a56f117b4b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff807ee8-35fb-4d62-98eb-e0b0abb7318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff807ee8-35fb-4d62-98eb-e0b0abb7318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3f1b29-c92d-4d5f-8207-da0eab575504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3f1b29-c92d-4d5f-8207-da0eab575504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3891f966-c5ea-46fb-b9d1-e90cd5680f17', 'volume_name': 'volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08f6bf4-d171-4086-833d-f4cf5998b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08f6bf4-d171-4086-833d-f4cf5998b399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4192deb4-6cba-415f-bab8-21e6b263111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:01 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Volume 3891f966-c5ea-46fb-b9d1-e90cd5680f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17', 'volume_size': 1} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871700896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3891f966-c5ea-46fb-b9d1-e90cd5680f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe1346f747343289be91ee2239bb3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:02Z,use_quota=True,user_id='30bb1159711e464b8189a56f117b4b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Creating volume 3891f966-c5ea-46fb-b9d1-e90cd5680f17 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:12:01 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:01 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 1073741824 Sep 07 11:12:01 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:01 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.275s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:01 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Deleted volume successfully. Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-74a96de2-f2bb-430b-aa04-57cf2758297d tempest-ProjectReaderTests-1426019831 None] Lock "cinder-7941d99c-a1ef-4dce-923a-13417fa24a83-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:02 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 1073741824" returned: 0 in 0.496s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:02 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 Sep 07 11:12:02 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (312d8045-1a97-472d-a9c6-48141b179578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8311e71e-de9e-41a0-bade-9d94e8f93742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8311e71e-de9e-41a0-bade-9d94e8f93742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141814976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7061f7-497c-49a9-b26f-34355aa823c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:02Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925d2d7e-1604-4475-8b15-56239b4603b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925d2d7e-1604-4475-8b15-56239b4603b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc23f6d9-7564-463c-9438-02daa8bf7659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc23f6d9-7564-463c-9438-02daa8bf7659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7061f7-497c-49a9-b26f-34355aa823c7', 'volume_name': 'volume-2a7061f7-497c-49a9-b26f-34355aa823c7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3751a21d-556b-40b8-ab60-fc631e59fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3751a21d-556b-40b8-ab60-fc631e59fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613ee191-df14-4430-87b3-9207ab9c8c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Volume 2a7061f7-497c-49a9-b26f-34355aa823c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7061f7-497c-49a9-b26f-34355aa823c7', 'volume_size': 1} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:02 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17" returned: 0 in 0.268s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141814976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7061f7-497c-49a9-b26f-34355aa823c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea4a889b1a492b8d74fc6e4a1b8d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:02Z,use_quota=True,user_id='7606c11f526441be8713ffb481c1834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Creating volume 2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:12:02 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:02 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 1073741824 Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4192deb4-6cba-415f-bab8-21e6b263111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:02 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6e4945-ec5f-4b9d-9292-023ecdeb65b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:02 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Volume volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 (3891f966-c5ea-46fb-b9d1-e90cd5680f17): created successfully Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6e4945-ec5f-4b9d-9292-023ecdeb65b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:02 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Flow 'volume_create_manager' (8d2a0943-375d-4630-9f94-4fdcf97482d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:02 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ea3ed45d-8549-4689-8248-5f8f64c8b766 tempest-ProjectReaderTests-1759639340 None] Created volume successfully. Sep 07 11:12:03 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 1073741824" returned: 0 in 0.392s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:03 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 Sep 07 11:12:03 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:03 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7" returned: 0 in 0.236s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613ee191-df14-4430-87b3-9207ab9c8c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7061f7-497c-49a9-b26f-34355aa823c7', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180a70be-4a57-4e15-b61d-205563fbeb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:03 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Volume volume-2a7061f7-497c-49a9-b26f-34355aa823c7 (2a7061f7-497c-49a9-b26f-34355aa823c7): created successfully Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180a70be-4a57-4e15-b61d-205563fbeb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Flow 'volume_create_manager' (312d8045-1a97-472d-a9c6-48141b179578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:03 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ed2faba1-2e4a-4902-959c-651119100a5c tempest-ProjectReaderTests-1426019831 None] Created volume successfully. Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Creating offline snapshot fa0dadeb-617f-4522-baf7-ef9bbedcf63d of volume 2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa430a02-8307-4482-9f21-e995b8f8d2e8]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:03 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 Sep 07 11:12:03 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Acquiring lock "cinder-3891f966-c5ea-46fb-b9d1-e90cd5680f17-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:03 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Lock "cinder-3891f966-c5ea-46fb-b9d1-e90cd5680f17-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Acquiring lock "cinder-quobyte-3891f966-c5ea-46fb-b9d1-e90cd5680f17" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Lock "cinder-quobyte-3891f966-c5ea-46fb-b9d1-e90cd5680f17" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:04 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7" returned: 0 in 0.403s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d 1G {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[8407ab39-188c-4ffd-a84e-6b5f7cb2e00d]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:04 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d 1G Sep 07 11:12:04 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:04 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 Sep 07 11:12:04 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:04 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:04 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d 1G" returned: 0 in 0.388s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7061f7-497c-49a9-b26f-34355aa823c7 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17" returned: 0 in 0.387s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:04 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7061f7-497c-49a9-b26f-34355aa823c7 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d Sep 07 11:12:04 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:04 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17 Sep 07 11:12:04 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:04 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-3891f966-c5ea-46fb-b9d1-e90cd5680f17" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Lock "cinder-quobyte-3891f966-c5ea-46fb-b9d1-e90cd5680f17" released by "delete_volume" :: held 0.683s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:04 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7061f7-497c-49a9-b26f-34355aa823c7 -F qcow2 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d" returned: 0 in 0.299s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:04 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d is being set with open permissions: ugo+rw Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:04 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d Sep 07 11:12:04 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Created reservations ['58f174e9-2dba-4946-af83-95b858f7a145', 'cba18b4c-afa2-4f9d-a672-36dcef7f66d6', '0bb436cc-f49d-4cb3-a92b-270089678057', '7a6ea5e6-2ed4-4a9c-bca4-691c6fc556a0'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:04 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:04 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:04 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:04 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:05 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.info Sep 07 11:12:05 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:05 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.269s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Deleted volume successfully. Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-d5633863-e9fa-4ed8-b6f3-e458051886eb tempest-ProjectReaderTests-1759639340 None] Lock "cinder-3891f966-c5ea-46fb-b9d1-e90cd5680f17-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:05 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.info" returned: 0 in 0.276s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:05 devstack cinder-volume[87271]: WARNING cinder.volume.drivers.remotefs [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.info is being set with open permissions: ugo+rw Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.info {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:05 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.info Sep 07 11:12:05 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:05 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.info" returned: 0 in 0.252s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:05 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-16a9e0f7-4cf1-4477-9f57-3ce1f10303f8 tempest-ProjectReaderTests-1426019831 None] Create snapshot completed successfully Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Flow 'volume_create_manager' (84efc90a-85d0-4b69-9119-08113f82c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf8d69d-4cb2-4b2b-97cb-6efd82171ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf8d69d-4cb2-4b2b-97cb-6efd82171ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037797356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae78dda9-509f-4ec8-b2d7-ab9be6ca7566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe1346f747343289be91ee2239bb3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:06Z,use_quota=True,user_id='30bb1159711e464b8189a56f117b4b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddad5f7-ce87-4bc9-80a6-cead5b96b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddad5f7-ce87-4bc9-80a6-cead5b96b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f99dde6-624e-4820-b26a-7ba51d927edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f99dde6-624e-4820-b26a-7ba51d927edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae78dda9-509f-4ec8-b2d7-ab9be6ca7566', 'volume_name': 'volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f9a089-bba4-4b32-ae55-72db25e12fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f9a089-bba4-4b32-ae55-72db25e12fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8686a6-c4ef-4325-a549-cb313116fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:05 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Volume ae78dda9-509f-4ec8-b2d7-ab9be6ca7566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566', 'volume_size': 1} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037797356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae78dda9-509f-4ec8-b2d7-ab9be6ca7566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe1346f747343289be91ee2239bb3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:06Z,use_quota=True,user_id='30bb1159711e464b8189a56f117b4b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Creating volume ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:12:05 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:05 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 1073741824 Sep 07 11:12:05 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-fa0dadeb-617f-4522-baf7-ef9bbedcf63d-delete_snapshot" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Lock "cinder-fa0dadeb-617f-4522-baf7-ef9bbedcf63d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-2a7061f7-497c-49a9-b26f-34355aa823c7" by "delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-2a7061f7-497c-49a9-b26f-34355aa823c7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-fa0dadeb-617f-4522-baf7-ef9bbedcf63d" by "_delete_snapshot" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-fa0dadeb-617f-4522-baf7-ef9bbedcf63d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Deleting offline snapshot fa0dadeb-617f-4522-baf7-ef9bbedcf63d of volume 2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] snapshot_file for this snap is: volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d {{(pid=87271) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[f032d1cc-c79a-4a96-828f-18b77674875a]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:05 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:05 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d Sep 07 11:12:05 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:06 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 1073741824" returned: 0 in 0.421s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:06 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 Sep 07 11:12:06 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:06 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7061f7-497c-49a9-b26f-34355aa823c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87271) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc956fdc-9e2e-46cd-82b2-be66bc81fcf9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:06 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 Sep 07 11:12:06 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:06 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566" returned: 0 in 0.248s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8686a6-c4ef-4325-a549-cb313116fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c4063f-cf8a-4843-88ca-901f882439b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:06 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Volume volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 (ae78dda9-509f-4ec8-b2d7-ab9be6ca7566): created successfully Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c4063f-cf8a-4843-88ca-901f882439b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Flow 'volume_create_manager' (84efc90a-85d0-4b69-9119-08113f82c857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:06 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-44e83c3e-e12c-40ee-8481-a1853dc4c772 tempest-ProjectReaderTests-1759639340 None] Created volume successfully. Sep 07 11:12:06 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7" returned: 0 in 0.375s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:06 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d Sep 07 11:12:06 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Acquiring lock "cinder-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Lock "cinder-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Acquiring lock "cinder-quobyte-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Lock "cinder-quobyte-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3ec53-2194-4060-ae5d-90bf561d4754]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:06 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 Sep 07 11:12:06 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:06 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d" returned: 0 in 0.358s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:06 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:06 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d Sep 07 11:12:06 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:07 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566" returned: 0 in 0.360s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:07 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566 Sep 07 11:12:07 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:07 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7.fa0dadeb-617f-4522-baf7-ef9bbedcf63d" returned: 0 in 0.259s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-fa0dadeb-617f-4522-baf7-ef9bbedcf63d" released by "_delete_snapshot" :: held 1.465s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-2a7061f7-497c-49a9-b26f-34355aa823c7" released by "delete_snapshot" :: held 1.495s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Created reservations ['513ece13-d3a0-4b1f-afa1-7e484b963f57', '512a72d0-bdcb-4d1b-8b4f-fe363aa0f770', 'c45d4408-0240-48b8-81cc-e0e352d2bbb8', 'fa9fcdef-380a-40cb-911b-f4ec711c5bb5'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:07 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566" returned: 0 in 0.280s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Lock "cinder-quobyte-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566" released by "delete_volume" :: held 0.681s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Delete snapshot completed successfully. Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-63bea9c5-ea27-497e-a685-f64c84327a8a tempest-ProjectReaderTests-1426019831 None] Lock "cinder-fa0dadeb-617f-4522-baf7-ef9bbedcf63d-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Created reservations ['432a8d37-1cdc-4485-9ba9-4e9daadc2fbd', '9ea7ea7b-82af-4ff8-8f90-b02b93e3a062', 'e5e61c18-41a4-4e2a-826e-80f19dc53fa3', '44825315-7bfb-41cc-a506-c715ef071fe8'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:07 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:07 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:07 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.270s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:07 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Deleted volume successfully. Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-ca8c2e9f-8d1a-4f19-bcac-e1f6e1659591 tempest-ProjectReaderTests-1759639340 None] Lock "cinder-ae78dda9-509f-4ec8-b2d7-ab9be6ca7566-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-2a7061f7-497c-49a9-b26f-34355aa823c7-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-2a7061f7-497c-49a9-b26f-34355aa823c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:07 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "cinder-quobyte-2a7061f7-497c-49a9-b26f-34355aa823c7" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-2a7061f7-497c-49a9-b26f-34355aa823c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211df6d-eb5f-4def-bc89-4f14dab82808]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:08 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 Sep 07 11:12:08 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:08 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7" returned: 0 in 0.370s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:08 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7 Sep 07 11:12:08 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:08 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-2a7061f7-497c-49a9-b26f-34355aa823c7" returned: 0 in 0.262s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-quobyte-2a7061f7-497c-49a9-b26f-34355aa823c7" released by "delete_volume" :: held 0.695s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Created reservations ['e9766f60-1b59-49f6-b862-3135a9421c2a', 'ea75061e-55ae-4da4-8d41-cddd0aae6a04', '1c14cee3-4919-40fc-9105-0de29cf1aa75', 'a95a3d51-f51d-498d-a173-eccda90c033f'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:08 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:08 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:08 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:09 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:09 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.256s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:09 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:09 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Deleted volume successfully. Sep 07 11:12:09 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-539ca516-5ba1-400d-a207-d228101d4e87 tempest-ProjectReaderTests-1426019831 None] Lock "cinder-2a7061f7-497c-49a9-b26f-34355aa823c7-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:10 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:10 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:10 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.273s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG oslo_service.periodic_task [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] Running periodic task VolumeManager._thread_info {{(pid=87271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread count: 29 {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 11:12:10 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-c3d33ebb-244c-499d-bd25-93095fa29846 None None] thread info: [<_MainThread(MainThread, started 139063818735744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (1763ddef-45b1-4df4-bd01-54625900626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8272699f-c9d2-44b7-8a0e-436177c30bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8272699f-c9d2-44b7-8a0e-436177c30bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090073460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2613dc-8656-4ee5-b424-2fcfc0c0b5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:12Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b2eda9-4690-4d1a-a347-b0bba545b09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b2eda9-4690-4d1a-a347-b0bba545b09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00eb88a-69c4-4d75-8463-e3b790e7669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00eb88a-69c4-4d75-8463-e3b790e7669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2613dc-8656-4ee5-b424-2fcfc0c0b5db', 'volume_name': 'volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851b90ad-1f7b-4126-850c-cbb473533040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851b90ad-1f7b-4126-850c-cbb473533040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65118a0-7e99-447f-9fc2-9dc17af967b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:11 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Volume 4f2613dc-8656-4ee5-b424-2fcfc0c0b5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db', 'volume_size': 1} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090073460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2613dc-8656-4ee5-b424-2fcfc0c0b5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:12Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Creating volume 4f2613dc-8656-4ee5-b424-2fcfc0c0b5db {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:12:11 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:12:11 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:11 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db 1073741824 Sep 07 11:12:11 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:12 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db 1073741824" returned: 0 in 0.391s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:12 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db Sep 07 11:12:12 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:12 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db" returned: 0 in 0.239s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65118a0-7e99-447f-9fc2-9dc17af967b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36820dc3-fb2a-4c8f-9eea-6238d9263aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:12 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Volume volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db (4f2613dc-8656-4ee5-b424-2fcfc0c0b5db): created successfully Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36820dc3-fb2a-4c8f-9eea-6238d9263aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (1763ddef-45b1-4df4-bd01-54625900626e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:12 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-e9f3aa7d-a747-4292-a2f3-04a36571d8b2 tempest-ProjectReaderTests-774060447 None] Created volume successfully. Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Lock "cinder-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-quobyte-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db" acquired by "delete_volume" :: waited 0.015s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b229c11-ff36-4ed9-8c2b-1c6d2eab96e3]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:12 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:13 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db Sep 07 11:12:13 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:13 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db" returned: 0 in 0.365s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:13 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db Sep 07 11:12:13 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:13 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db" returned: 0 in 0.254s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db" released by "delete_volume" :: held 0.658s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Created reservations ['df0fd686-730b-4911-b2f2-4ceaa10ba699', '3c95897f-16fc-4724-9561-a133af5afad9', 'adaa5a50-00d4-4efd-b200-1acff2c995ed', '14951dfd-f742-48c1-b1ac-1f3caf63278d'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:13 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:13 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:13 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.244s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:13 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Deleted volume successfully. Sep 07 11:12:13 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-9a010cf9-07f8-48d2-8d15-dd8e32769d15 tempest-ProjectReaderTests-774060447 None] Lock "cinder-4f2613dc-8656-4ee5-b424-2fcfc0c0b5db-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (d18742ec-298d-4c19-b1bd-71ea04303d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2a6771-bcbf-4439-844b-84a9e63a145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2a6771-bcbf-4439-844b-84a9e63a145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044339558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc693da-b24d-4373-85e9-6f83517f165e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:14Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05bc615-a09e-4917-a774-d21c4e5cc436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05bc615-a09e-4917-a774-d21c4e5cc436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd14e2fa-a439-4a6d-92ef-33d1d821a157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd14e2fa-a439-4a6d-92ef-33d1d821a157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc693da-b24d-4373-85e9-6f83517f165e', 'volume_name': 'volume-afc693da-b24d-4373-85e9-6f83517f165e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cdfcb6-9d86-43ac-8311-bedfdf34bb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cdfcb6-9d86-43ac-8311-bedfdf34bb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a4dc7d-c355-446d-92d8-4e9e4b7ce1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:14 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Volume afc693da-b24d-4373-85e9-6f83517f165e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc693da-b24d-4373-85e9-6f83517f165e', 'volume_size': 1} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044339558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc693da-b24d-4373-85e9-6f83517f165e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:14Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Creating volume afc693da-b24d-4373-85e9-6f83517f165e {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:12:14 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:14 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e 1073741824 Sep 07 11:12:14 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:14 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e 1073741824" returned: 0 in 0.404s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:14 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:14 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e Sep 07 11:12:15 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:15 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e" returned: 0 in 0.249s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a4dc7d-c355-446d-92d8-4e9e4b7ce1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc693da-b24d-4373-85e9-6f83517f165e', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03a7f55-4181-484f-9f00-00ba0ff22445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:15 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Volume volume-afc693da-b24d-4373-85e9-6f83517f165e (afc693da-b24d-4373-85e9-6f83517f165e): created successfully Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03a7f55-4181-484f-9f00-00ba0ff22445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (d18742ec-298d-4c19-b1bd-71ea04303d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:15 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-b0dd2e42-2860-477c-b80a-8758e02e0f24 tempest-ProjectReaderTests-774060447 None] Created volume successfully. Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-afc693da-b24d-4373-85e9-6f83517f165e-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Lock "cinder-afc693da-b24d-4373-85e9-6f83517f165e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-quobyte-afc693da-b24d-4373-85e9-6f83517f165e" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-afc693da-b24d-4373-85e9-6f83517f165e" acquired by "delete_volume" :: waited 0.017s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c25017-9ab4-4105-bc1f-5c8f73b261f9]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:15 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e Sep 07 11:12:15 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:15 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e" returned: 0 in 0.348s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:15 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:15 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e Sep 07 11:12:15 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:16 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-afc693da-b24d-4373-85e9-6f83517f165e" returned: 0 in 0.238s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-afc693da-b24d-4373-85e9-6f83517f165e" released by "delete_volume" :: held 0.628s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Created reservations ['35632fc7-2d18-42db-b1f1-5f64f02cade6', '26ec604d-1c2e-4404-b58b-19f106a43a99', '2392875b-f383-4151-b66d-e381fdd5e0d9', 'c23d07b3-32a2-4e79-9eb5-2d82c006c886'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:16 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:16 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:16 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.237s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:16 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Deleted volume successfully. Sep 07 11:12:16 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-5cb8f060-67f1-437b-a5e2-2b341f78d9d8 tempest-ProjectReaderTests-774060447 None] Lock "cinder-afc693da-b24d-4373-85e9-6f83517f165e-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (a1149a06-e5fe-414e-87c3-b56d7a5d8ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfc9893-dbf5-4472-a43a-3635238f4017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfc9893-dbf5-4472-a43a-3635238f4017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415704532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3d4688-f18a-4838-986f-cdf45745be63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:17Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb44e416-fd4c-439e-8719-5f356130b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb44e416-fd4c-439e-8719-5f356130b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef8294b-8ae2-4f83-94dd-38d76e3504c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef8294b-8ae2-4f83-94dd-38d76e3504c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3d4688-f18a-4838-986f-cdf45745be63', 'volume_name': 'volume-7d3d4688-f18a-4838-986f-cdf45745be63', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568ccab6-f935-4405-bb83-f755553b9337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568ccab6-f935-4405-bb83-f755553b9337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b2528a-a419-4b8b-990c-2e283fc3d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:17 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Volume 7d3d4688-f18a-4838-986f-cdf45745be63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3d4688-f18a-4838-986f-cdf45745be63', 'volume_size': 1} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415704532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3d4688-f18a-4838-986f-cdf45745be63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:17Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Creating volume 7d3d4688-f18a-4838-986f-cdf45745be63 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:12:17 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:17 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 1073741824 Sep 07 11:12:17 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:17 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 1073741824" returned: 0 in 0.401s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:17 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 Sep 07 11:12:17 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:17 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63" returned: 0 in 0.258s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b2528a-a419-4b8b-990c-2e283fc3d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3d4688-f18a-4838-986f-cdf45745be63', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b73b5c-b7c5-426f-af73-96448ea6cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:17 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Volume volume-7d3d4688-f18a-4838-986f-cdf45745be63 (7d3d4688-f18a-4838-986f-cdf45745be63): created successfully Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b73b5c-b7c5-426f-af73-96448ea6cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:17 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (a1149a06-e5fe-414e-87c3-b56d7a5d8ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:17 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-04b06e50-048f-49bb-8784-e149b34d9aa2 tempest-ProjectReaderTests-774060447 None] Created volume successfully. Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-7d3d4688-f18a-4838-986f-cdf45745be63-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Lock "cinder-7d3d4688-f18a-4838-986f-cdf45745be63-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-quobyte-7d3d4688-f18a-4838-986f-cdf45745be63" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-7d3d4688-f18a-4838-986f-cdf45745be63" acquired by "delete_volume" :: waited 0.014s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c89c3fd-0042-4361-ac44-26f27442653e]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:18 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 Sep 07 11:12:18 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:18 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63" returned: 0 in 0.354s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:18 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63 Sep 07 11:12:18 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:18 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-7d3d4688-f18a-4838-986f-cdf45745be63" returned: 0 in 0.243s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-7d3d4688-f18a-4838-986f-cdf45745be63" released by "delete_volume" :: held 0.633s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Created reservations ['94cbdee7-9785-4a22-8446-81beb4d07139', '10011cbe-c4ba-4935-891d-15f0c99dc4ad', '37ff1249-4e9d-4775-aca1-96bcdd88607f', '50ad9e5f-e577-41c8-898d-4cd89806fb1e'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:18 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:18 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:18 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:19 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.241s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:19 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Deleted volume successfully. Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-1342b14a-81d6-46cd-8eeb-3e9544c9670d tempest-ProjectReaderTests-774060447 None] Lock "cinder-7d3d4688-f18a-4838-986f-cdf45745be63-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87271) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (2bf697ca-31cc-487f-93e8-988b5f6c04af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bd8b9a-766d-4d74-9671-aa6ad094f70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bd8b9a-766d-4d74-9671-aa6ad094f70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022314363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac270e3f-f464-4477-8b28-2a0b9ef2f848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:20Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec3fc7b-fb42-462b-8c39-885f091b4f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec3fc7b-fb42-462b-8c39-885f091b4f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95a8ca4-fdd1-42cc-ab92-b71acda513d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95a8ca4-fdd1-42cc-ab92-b71acda513d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac270e3f-f464-4477-8b28-2a0b9ef2f848', 'volume_name': 'volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e82475-0bc0-4eca-9497-d624b247db36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e82475-0bc0-4eca-9497-d624b247db36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbb3b61-8fe5-4ee4-a4b3-fc2f82c61a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:19 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Volume ac270e3f-f464-4477-8b28-2a0b9ef2f848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848', 'volume_size': 1} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T09:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022314363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac270e3f-f464-4477-8b28-2a0b9ef2f848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f2160285d4492aca4a1869fb33610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T09:12:20Z,use_quota=True,user_id='b1460b9599324db5b60f4243c29bc3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff),volume_type_id=3623bf78-8bc5-4f1e-bc4f-16e0c2d143ff)}" {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.remotefs [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Creating volume ac270e3f-f464-4477-8b28-2a0b9ef2f848 {{(pid=87271) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Selected osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e as target Quobyte volume. {{(pid=87271) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 11:12:19 devstack cinder-volume[87271]: INFO cinder.volume.drivers.remotefs [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] casted to osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e Sep 07 11:12:19 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 1073741824 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:19 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 1073741824 Sep 07 11:12:19 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:20 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 1073741824" returned: 0 in 0.397s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:20 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 Sep 07 11:12:20 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:20 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848" returned: 0 in 0.235s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'} {{(pid=87271) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbb3b61-8fe5-4ee4-a4b3-fc2f82c61a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848', 'volume_size': 1}' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01533ea3-aca3-4914-866d-7bdbd108f79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 11:12:20 devstack cinder-volume[87271]: INFO cinder.volume.flows.manager.create_volume [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Volume volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 (ac270e3f-f464-4477-8b28-2a0b9ef2f848): created successfully Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01533ea3-aca3-4914-866d-7bdbd108f79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87271) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Flow 'volume_create_manager' (2bf697ca-31cc-487f-93e8-988b5f6c04af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87271) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 11:12:20 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-4d255521-cb11-4ef4-aa90-721c49d08523 tempest-ProjectReaderTests-774060447 None] Created volume successfully. Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-ac270e3f-f464-4477-8b28-2a0b9ef2f848-delete_volume" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Lock "cinder-ac270e3f-f464-4477-8b28-2a0b9ef2f848-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Acquiring lock "cinder-quobyte-ac270e3f-f464-4477-8b28-2a0b9ef2f848" by "delete_volume" {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-ac270e3f-f464-4477-8b28-2a0b9ef2f848" acquired by "delete_volume" :: waited 0.016s {{(pid=87271) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22ecdff-68f5-43d1-ad9f-37ca2d46c9c1]: (4, 'qcow2') {{(pid=89121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 11:12:20 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:20 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 Sep 07 11:12:20 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:21 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848" returned: 0 in 0.352s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:21 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848 Sep 07 11:12:21 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:21 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742/volume-ac270e3f-f464-4477-8b28-2a0b9ef2f848" returned: 0 in 0.241s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Lock "cinder-quobyte-ac270e3f-f464-4477-8b28-2a0b9ef2f848" released by "delete_volume" :: held 0.634s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG cinder.quota [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Created reservations ['e60203f7-cba7-4d20-867d-76f2b3f4029d', '17f94a9d-4018-429c-af68-77c2bb5e9f10', '3cade844-7ac3-4dc2-be3c-8f92aa86e47b', '31ccd1f2-d912-48d1-a7b6-a22945317ae4'] {{(pid=87271) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e': None} {{(pid=87271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG cinder.volume.drivers.quobyte [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49c5b0a7-2053-4c5d-8f78-064c3e87dd2e'] {{(pid=87271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.lockutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 11:12:21 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742 Sep 07 11:12:21 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 11:12:21 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG oslo_concurrency.processutils [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e0e432bbc16b46f32fea3d1446318742" returned: 0 in 0.246s {{(pid=87271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG cinder.manager [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Notifying Schedulers of capabilities ... {{(pid=87271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 11:12:21 devstack cinder-volume[87271]: INFO cinder.volume.manager [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Deleted volume successfully. Sep 07 11:12:21 devstack cinder-volume[87271]: DEBUG cinder.coordination [None req-0dec44df-d50a-48e3-8864-9accad1fc331 tempest-ProjectReaderTests-774060447 None] Lock "cinder-ac270e3f-f464-4477-8b28-2a0b9ef2f848-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87271) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 11:12:31 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:UPDATE=104,cinder:SELECT=64,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 11:12:31 devstack cinder-volume[87271]: DEBUG dbcounter [-] [87271] Writing DB stats cinder:SELECT=76,cinder:INSERT=26,cinder:UPDATE=108,cinder:DELETE=7 {{(pid=87271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}